Podchaser Logo
Home
Episode 33: Tri Dao, Stanford: On FlashAttention and sparsity, quantization, and efficient inference

Episode 33: Tri Dao, Stanford: On FlashAttention and sparsity, quantization, and efficient inference

Released Wednesday, 9th August 2023
Good episode? Give it some love!
Episode 33: Tri Dao, Stanford: On FlashAttention and sparsity, quantization, and efficient inference

Episode 33: Tri Dao, Stanford: On FlashAttention and sparsity, quantization, and efficient inference

Episode 33: Tri Dao, Stanford: On FlashAttention and sparsity, quantization, and efficient inference

Episode 33: Tri Dao, Stanford: On FlashAttention and sparsity, quantization, and efficient inference

Wednesday, 9th August 2023
Good episode? Give it some love!
Rate Episode

Tri Dao is a PhD student at Stanford, co-advised by Stefano Ermon and Chris Re. He’ll be joining Princeton as an assistant professor next year. He works at the intersection of machine learning and systems, currently focused on efficient training and long-range context.


About Generally Intelligent 

We started Generally Intelligent because we believe that software with human-level intelligence will have a transformative impact on the world. We’re dedicated to ensuring that that impact is a positive one.  

We have enough funding to freely pursue our research goals over the next decade, and our backers include Y Combinator, researchers from OpenAI, Astera Institute, and a number of private individuals who care about effective altruism and scientific research.  

Our research is focused on agents for digital environments (ex: browser, desktop, documents), using RL, large language models, and self supervised learning. We’re excited about opportunities to use simulated data, network architecture search, and good theoretical understanding of deep learning to make progress on these problems. We take a focused, engineering-driven approach to research.  


Learn more about us

Website: https://generallyintelligent.com/

LinkedIn: linkedin.com/company/generallyintelligent/ 

Twitter: @genintelligent

Show More
Rate

Join Podchaser to...

  • Rate podcasts and episodes
  • Follow podcasts and creators
  • Create podcast and episode lists
  • & much more

Episode Tags

Do you host or manage this podcast?
Claim and edit this page to your liking.
,

Unlock more with Podchaser Pro

  • Audience Insights
  • Contact Information
  • Demographics
  • Charts
  • Sponsor History
  • and More!
Pro Features