Skip to content
View Awni00's full-sized avatar
15 followers · 5 following

Block or report Awni00

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Maximum 250 characters. Please don't include any personal information such as legal names or email addresses. Markdown supported. This note will be visible to only you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
awni00/README.md

💫 About Me:

I'm a PhD student in Statistics & Data Science at Yale.

My research studies the foundations of machine intelligence, with an emphasis on generalization, representation, and learning.

I explore these themes through complementary theoretical analysis and empirical investigation:

- Deep learning, representation learning, & inductive structure: Developing novel methods and architectures to improve systematic compositional generalization and data efficiency, sometimes drawing inspiration from biological intelligence to achieve human-like reasoning and out-of-distribution generalization.
- Theory of modern learning systems: Developing frameworks that explain empirical phenomena in contemporary machine learning through unified statistical and computational principles, aiming to develop a foundation for future progress in artificial intelligence.

Where to start: If you're interested in neural network architectures, check out our work on an extension of the transformer architecture with explicit relational mechanisms and inductive biases (blog ⧉). For theoretical analysis of modern machine learning methods, see our statistical learning theory framework for chain-of-thought supervised learning (blog ⧉).

Pinned Loading

  1. neurol neurol Public

    A framework for implementing modular Brain-Computer Interfaces

    Python 7 4

  2. abstractor abstractor Public

    This is the code repository associated with the paper "Abstractors and relational cross-attention: An inductive bias for explicit relational reasoning in Transformers"

    Jupyter Notebook 21 3

  3. hierarchical-attention-external-memory hierarchical-attention-external-memory Public

    Hierarchical attention mechanisms for external memory in machine learning models.

    Jupyter Notebook

  4. high-dim-universality-erm high-dim-universality-erm Public

    Numerical experiments exploring the "universality" of empirical risk minimization in high dimensions.

    HTML

  5. relational-convolutions relational-convolutions Public

    This is the project repo associated with the paper "Relational Convolutional Networks: A framework for learning representations of hierarchical relations" by Awni Altabaa, John Lafferty

    Jupyter Notebook 4 1

  6. abstract_transformer abstract_transformer Public

    This is the project repo associated with the paper "Disentangling and Integrating Relational and Sensory Information in Transformer Architectures" by Awni Altabaa, John Lafferty

    Jupyter Notebook 6