#llm #ai #chatgpt How does one run inference for a generative autoregressive language model that has been trained with a fixed context size? Streaming LLMs combine the performance of windowed attention, but avoid the drop in performance by us

Promptbreeder: Self-Referential Self-Improvement Via Prompt Evolution (Paper Explained)

Oct 17th, 2023 46m 44s

#ai #promptengineering #evolution Promptbreeder is a self-improving self-referential system for automated prompt engineering. Give it a task description and a dataset, and it will automatically come up with appropriate prompts for the task. T

Retentive Network: A Successor to Transformer for Large Language Models (Paper Explained)

Oct 5th, 2023 28m 25s

#ai #retnet #transformers Retention is an alternative to Attention in Transformers that can both be written in a parallel and in a recurrent fashion. This means the architecture achieves training parallelism while maintaining low-cost inferen

Reinforced Self-Training (ReST) for Language Modeling (Paper Explained)

Oct 5th, 2023 53m 6s

#ai #rlhf #llm ReST uses a bootsrap-like method to produce its own extended dataset and trains on ever higher-quality subsets of it to improve its own reward. The method allows for re-using the same generated data multiple times and thus has

[ML News] LLaMA2 Released | LLMs for Robots | Multimodality on the Rise

Aug 28th, 2023 44m 10s

#mlnews #llama2 #openai Your regular irregular update on the world of Machine Learning.References:https://twitter.com/ylecun/status/1681336284453781505https://ai.meta.com/llama/https://about.fb.com/news/2023/07/llama-2-statement-of-suppo

How Cyber Criminals Are Using ChatGPT (w/ Sergey Shykevich)

Aug 28th, 2023 29m 8s

#cybercrime #chatgpt #security An interview with Sergey Shykevich, Threat Intelligence Group Manager at Check Point, about how models like ChatGPT have impacted the realm of cyber crime.https://threatmap.checkpoint.com/Links:Homepage: ht

Recipe AI suggests FATAL CHLORINE GAS Recipe

Aug 28th, 2023 7m 5s

#llm #safety #gpt4 A prime example of intellectual dishonesty of journalists and AI critics.Article: https://gizmodo.com/paknsave-ai-savey-recipe-bot-chlorine-gas-1850725057My Recipe AI: https://github.com/yk/recipe-aiLinks:Homepage: ht

DeepFloyd IF - Pixel-Based Text-to-Image Diffusion (w/ Authors)

Aug 28th, 2023 53m 31s

#ai #diffusion #stabilityai An interview with DeepFloyd members Misha Konstantinov and Daria Bakshandaeva on the release of the model IF, an open-source model following Google's implementation of Imagen.References:https://www.deepfloyd.ai/

[ML News] GPT-4 solves MIT Exam with 100% ACCURACY | OpenLLaMA 13B released

Aug 28th, 2023 31m 4s

#gpt4 #mit #ai A new paper claims to use GPT-4 to solve 100% of a set of MIT university exercises. Some people are skeptic and their investigations reveal more than one problem with this paper...OUTLINE:0:00 - ChatGPT gives out Windows 10

Tree-Ring Watermarks: Fingerprints for Diffusion Images that are Invisible and Robust (Explained)

Aug 28th, 2023 35m 44s

#stablediffusion #ai #watermark Watermarking the outputs of generative models is usually done as a post-processing step on the model outputs. Tree-Ring Watermarks are applied in the latent space at the beginning of a diffusion process, which

RWKV: Reinventing RNNs for the Transformer Era (Paper Explained)

Aug 28th, 2023 1h 2m

#gpt4 #rwkv #transformer We take a look at RWKV, a highly scalable architecture between Transformers and RNNs.Fully Connected (June 7th in SF) Promo Link: https://www.fullyconnected.com/?promo=ynncOUTLINE:0:00 - Introduction1:50 - Fully

Tree of Thoughts: Deliberate Problem Solving with Large Language Models (Full Paper Review)

Aug 28th, 2023 29m 28s

#gpt4 #ai #prompt Tree-of-Thought improves prompting of large language models (LLMs) by generalizing the concept of Chain-of-Thought prompting and introduces a tree search across language model thoughts, including state evaluation and backtra

OpenAI suggests AI licenses (US Senate hearing on AI regulation w/ Sam Altman)

Aug 28th, 2023 16m 12s

#ai #openai #gpt4 US Senate hearing on AI regulation.MLST video on the hearing: https://www.youtube.com/watch?v=DeSXnESGxr4Links:Homepage: https://ykilcher.comMerch: https://ykilcher.com/merchYouTube: https://www.youtube.com/c/yannicki

[ML News] Geoff Hinton leaves Google | Google has NO MOAT | OpenAI down half a billion

Aug 28th, 2023 39m 6s

#google #openai #mlnews Updates from the world of Machine Learning and AIGreat AI memes here: https://twitter.com/untitled01ipynbOUTLINE:0:00 - Google I/O 2023: Generative AI in everything0:20 - Anthropic announces 100k tokens context0:

Scaling Transformer to 1M tokens and beyond with RMT (Paper Explained)

Aug 28th, 2023 24m 33s

#ai #transformer #gpt4 This paper promises to scale transformers to 1 million tokens and beyond. We take a look at the technique behind it: The Recurrent Memory Transformer, and what its strenghts and weaknesses are.OUTLINE:0:00 - Intro2:

OpenAssistant RELEASED! The world's best open-source Chat AI!

Aug 28th, 2023 21m 5s

#openassistant #chatgpt #mlnews Try the chat: https://open-assistant.io/chatHomepage: https://open-assistant.io Dataset: https://huggingface.co/datasets/OpenAssistant/oasst1Code: https://github.com/LAION-AI/Open-AssistantPaper (temporary)

OpenAssistant First Models are here! (Open-Source ChatGPT)

Aug 28th, 2023 16m 52s

#openassistant #chatgpt #gpt4https://open-assistant.io/chathttps://huggingface.co/OpenAssistanthttps://github.com/LAION-AI/Open-AssistantLinks:Homepage: https://ykilcher.comMerch: https://ykilcher.com/merchYouTube: https://www.youtube.com/

The biggest week in AI (GPT-4, Office Copilot, Google PaLM, Anthropic Claude & more)

Aug 28th, 2023 41m 1s

#mlnews #gpt4 #copilotYour weekly news all around the AI worldCheck out W&B courses (free): https://wandb.courses/OUTLINE:0:00 - Intro0:20 - GPT-4 announced!4:30 - GigaGAN: The comeback of Generative Adversarial Networks7:55 - Chopped

GPT-4 is here! What we know so far (Full Analysis)

Aug 28th, 2023 34m 9s

#gpt4 #chatgpt #openai References:https://openai.com/product/gpt-4https://openai.com/research/gpt-4https://cdn.openai.com/papers/gpt-4.pdfLinks:Homepage: https://ykilcher.comMerch: https://ykilcher.com/merchYouTube: https://www.youtube.

This ChatGPT Skill will earn you $10B (also, AI reads your mind!)

Aug 28th, 2023 43m 27s

#mlnews #chatgpt #llamaChatGPT goes around the world and is finally available via API. Stunning mind-reading performed using fMRI and Stable Diffusion. LLaMA weights leak and hilarity ensues. GTC23 is around the corner!ERRATA: It's a 4090,

LLaMA: Open and Efficient Foundation Language Models (Paper Explained)

Aug 28th, 2023 41m 6s

#ai #meta #languagemodel LLaMA is a series of large language models from 7B to 65B parameters, trained by Meta AI. They train for longer on more data and show that something like gpt-3 can be outperformed by significantly smaller models when

Open Assistant Inference Backend Development (Hands-On Coding)

Aug 28th, 2023 1h 21m

#ai #huggingface #coding Join me as I build streaming inference into the Hugging Face text generation server, going through cuda, python, rust, grpc, websockets, server-sent events, and more...Original repo is here: https://github.com/huggi

OpenAssistant - ChatGPT's Open Alternative (We need your help!)

Aug 28th, 2023 35m 47s

#openassistant #chatgpt #ai Help us collect data for OpenAssistant, the largest and most open alternative to ChatGPT.https://open-assistant.ioOUTLINE:0:00 - Intro0:30 - The Project2:05 - Getting to Minimum Viable Prototype5:30 - First

ChatGPT: This AI has a JAILBREAK?! (Unbelievable AI Progress)

Jan 2nd, 2023 31m 54s

#chatgpt #ai #openai ChatGPT, OpenAI's newest model is a GPT-3 variant that has been fine-tuned using Reinforcement Learning from Human Feedback, and it is taking the world by storm!Sponsor: Weights & Biaseshttps://wandb.me/yannicOUTLINE

[ML News] GPT-4 Rumors | AI Mind Reading | Neuron Interaction Solved | AI Theorem Proving

Nov 30th, 2022 41m 55s

#ai #mlnews #gpt4Your weekly news from the AI & Machine Learning world.OUTLINE:0:00 - Introduction0:25 - AI reads brain signals to predict what you're thinking3:00 - Closed-form solution for neuron interactions4:15 - GPT-4 rumors6:50 -