app
Concept Learning and Abstraction

Scaling AI for lifelong learning and reasoning requires the ability to transform raw inputs into abstract concepts that can be efficiently composed to form more complex ones. Our lab has a strong focus on few-shot learning for concept acquisition. In recent research, we have enabled large-scale foundation models to incrementally learn new language and visual concepts. Our current efforts extend to recognizing functional and relational concepts, as well as exploring how learned concepts can be composed hierarchically for high-level reasoning. These advancements are key to building AI systems that generalize efficiently and adapt continuously to new tasks.

Research Works in the Area

design

Seeking the Unfamiliar but Memorable: Conceptual Creativity as Meta-Learning

Creativity is producing stimuli that are unfamiliar at first sight but quickly learnable from a few exposures. A Creator-Appraiser meta-learning loop lets a frozen diffusion model generate novel concepts the base model would not.

Published: 2026-05-15

Learn more
design

In-Context Clustering with Large Language Models

In-Context Clustering (ICC) is a flexible LLM-based procedure for clustering data from diverse distributions.

Published: 2025-10-09

Learn more
design

Context Tuning for In-Context Optimization

Context Tuning directly optimizes an LLM's memory representation for efficient adaptation without updating model weights.

Published: 2026-07-03

Learn more
design

Discrete JEPA: Learning Discrete Token Representations without Reconstruction

Discrete-JEPA extends the latent predictive coding JEPA framework with semantic tokenization and complementary objectives for symbolic reasoning tasks.

Published: 2025-06-22

Learn more
design

ProCreate, Don't Reproduce! Propulsive Energy Diffusion for Creative Generation

ProCreate is a simple and easy-to-implement method to improve sample diversity and creativity of diffusion-based image generative models and to prevent training data reproduction.

Published: 2024-08-05

Learn more
design

CoLLEGe: Concept Embedding Generation for Large Language Models

CoLLEGe is a meta-learning framework capable of generating flexible embeddings for new concepts using a small number of example sentences or definitions.

Published: 2024-03-22

Learn more