Connor Shorten
Connor Shorten
  • Видео 296
  • Просмотров 2 768 058
Google Gemini 1.5 Pro and Flash - Demo of Long Context LLMs!
Hey everyone! Thanks so much for watching this video exploring Gemini Pro 1.5 and Gemini Flash! Long Context LLMs!! This video covers 3 key tests, the classic "Lost in the Middle" exploration, using Long Context LLMs as Re-rankers in Search, and finally, testing Many-Shot In-Context Learning! I am really excited about the potential of Many-Shot In-Context Learning with DSPy's `BootstrapFewShot` and Gemini, curious to know what you think!
Notebook: github.com/weaviate/recipes/blob/main/integrations/llm-frameworks/dspy/llms/Gemini-1.5-Pro-and-Flash.ipynb
Gemini 1.5 Technical Report: storage.googleapis.com/deepmind-media/gemini/gemini_v1_5_report.pdf
Chapters
0:00 Gemini 1.5!!
1:25 Setup and Over...
Просмотров: 1 692

Видео

Llama 3 RAG Demo with DSPy Optimization, Ollama, and Weaviate!
Просмотров 14 тыс.2 месяца назад
Hey everyone! Thank you so much for watching this overview of Llama 3 looking at the release notes and seeing a demo of how to integrate it with DSPy through Ollama and how to use DSPy's MIPRO to find the optimal prompt when using this new large language model for RAG! We are hosting an event in San Francisco on May 1st with Arize AI and Cohere, featuring a talk from Omar Khattab, the lead auth...
Building RAG with Command R+ from Cohere, DSPy, and Weaviate!
Просмотров 3,7 тыс.2 месяца назад
Hey everyone! Thank you so much for watching this overview of Command R showing you how you can use the new model in DSPy and a quick RAG demo, as well as walking through the details of the release post! Congratulations to the Cohere team! Super exciting times to be working with LLM systems! Introducing Command R : A Scalable LLM Built for Business - txt.cohere.com/command-r-plus-microsoft-azur...
Structured Outputs with DSPy
Просмотров 6 тыс.2 месяца назад
The code for this notebook can be found here! - github.com/weaviate/recipes/blob/main/integrations/llm-frameworks/dspy/4.Structured-Outputs-with-DSPy.ipynb Unfortunately, Large Language Models will not consistently follow the instructions that you give them. This is a massive problem when you are building AI systems that require a particular type of output from the previous step to feed into th...
Adding Depth to DSPy Programs
Просмотров 6 тыс.3 месяца назад
Hey everyone! Thank you so much for watching the 3rd edition of the DSPy series, Adding Depth to DSPy Programs!! This video begins with some DSPy news such as STORM, DSPy Assertions, and Typed Signatures! We then dive into the concept of adding depth to DSPy programs, taking a further look at what it means to have unique input-output examples for each component and how we can compose DSPy progr...
Getting Started with RAG in DSPy!
Просмотров 12 тыс.4 месяца назад
Hey everyone! Thank you so much for watching this tutorial on getting started with RAG programming in DSPy! This video will take you through 4 major aspects of building DSPy programs (1) Installation, settings, and Datasets with dspy.Example, (2) LLM Metrics, (3) The DSPy programming model, and (4) Optimization!! The notebook used in the video can be found here: github.com/weaviate/recipes/blob...
DSPy Explained!
Просмотров 49 тыс.4 месяца назад
Hey everyone! Thank you so much for watching this explanation of DSPy! DSPy is a super exciting new framework for developing LLM programs! Pioneered by frameworks such as LangChain and LlamaIndex, we can build much more powerful systems by chaining together LLM calls! This means that the output of one call to an LLM is the input to the next, and so on. We can think of chains as programs, with e...
Approximate Nearest Neighbor Benchmarks - Weaviate Podcast Recap
Просмотров 9132 года назад
Please check out the full podcast here: ruclips.net/video/kG3ji89AFyQ/видео.html This video is a commentary on the latest Weaviate Podcast with Etienne Dilocker on ANN Benchmarks. ANN search short for Approximate Nearest Neighbors describes algorithms that enable efficient distance comparison between an encoded query vector and a vector database. For example, we may have 1 billion vectors to se...
Search through Y Combinator startups with Weaviate!
Просмотров 1,5 тыс.2 года назад
Please check out Eric Jang's article "Ranking YC Companies with a Neural Net": evjang.com/2022/04/02/yc-rank.html Please subscribe to SeMI Technologies on RUclips! ruclips.net/user/SeMI-and-Weaviate Timecodes 0:00 Introduction 0:58 Weaviate Demo 3:40 Article Overview 10:45 NLP for Venture Capital and Data-Centric AI
MosaicML Composer for faster and cheaper Deep Learning!
Просмотров 3,5 тыс.2 года назад
Please leave a star! github.com/mosaicml/composer Thank you so much for watching! This video presents some details of MosaicML's Composer launch and how to use it in Python. I am really excited about this company and their mission to deliver faster and cheaper Deep Learning training! I hope you find this video useful, happy to answer any questions you might have about this or these ideas in Eff...
Jina AI DocArray - Documentation Overview
Просмотров 2 тыс.2 года назад
I hope you found this useful, please let me know if you have any questions or ideas! Docarray Documentation: docarray.jina.ai/ Full-Length Podcast: ruclips.net/video/HIGAQAE_xaI/видео.html Code Tutorial (Weaviate Jina AI for Image Search): ruclips.net/video/rBKvoIGihnY/видео.html Please check out Jina AI on RUclips: ruclips.net/user/JinaAI Please check out SeMI Technologies on RUclips: ruclips....
What lead Jina AI CEO Han Xiao to Neural Search?
Просмотров 8372 года назад
This video explains one of the biggest lessons for me in interviewing Han Xiao from Jina AI. I hope this was a good explanation of the preprocessing / granularity of embeddings and how that can enable different kinds of search applications. Full-Length Podcast: ruclips.net/video/HIGAQAE_xaI/видео.html Code Tutorial (Weaviate Jina AI for Image Search): ruclips.net/video/rBKvoIGihnY/видео.html Pl...
Full Stack Neural Search
Просмотров 1,8 тыс.2 года назад
This video explains one of the biggest lessons for me in interviewing Han Xiao from Jina AI. I hope this was a good explanation of the preprocessing / granularity of embeddings and how that can enable different kinds of search applications. Full-Length Podcast: ruclips.net/video/HIGAQAE_xaI/видео.html Code Tutorial (Weaviate Jina AI for Image Search): ruclips.net/video/rBKvoIGihnY/видео.html Pl...
Python Tutorial: How to use Weaviate and Jina AI for Image Search!
Просмотров 2,2 тыс.2 года назад
I hope this video helps you get started with Image Search using Weaviate and Jina AI - happy to answer any questions / help solve problems! Check out the full tutorial explanation from Laura Ham: ruclips.net/video/rBKvoIGihnY/видео.html New podcast with Jina AI CEO Han Xiao! ruclips.net/video/HIGAQAE_xaI/видео.html Full notebook code: github.com/laura-ham/HM-Fashion-image-neural-search/blob/mai...
Causal Inference in Deep Learning (Podcast Overview with Brady Neal)
Просмотров 2,2 тыс.2 года назад
Hey everyone! Hopefully this video helps supplement the new Weaviate podcast with Brady Neal, I hope you find this interesting / useful! Check out Brady Neal on RUclips! ruclips.net/user/BradyNealCausalInferencefeatured Weaviate Podcast: ruclips.net/video/t7g9s1GWcB8/видео.html 0:00 New Weaviate Podcast! 0:42 Brady Neal Causal Inference 1:34 Oogway.ai 2:45 Whiteboard Ideas 5:35 Discussion Topics
OpenAI Embeddings API - (Interview Recap and Background)
Просмотров 6 тыс.2 года назад
OpenAI Embeddings API - (Interview Recap and Background)
AI Weekly Update - February 7th, 2022
Просмотров 2,6 тыс.2 года назад
AI Weekly Update - February 7th, 2022
Deep Learning for Podcast Content Search (Summary of Interview with Alex Canan at Zencastr)
Просмотров 7532 года назад
Deep Learning for Podcast Content Search (Summary of Interview with Alex Canan at Zencastr)
AI Weekly Update - January 31st, 2022
Просмотров 1,9 тыс.2 года назад
AI Weekly Update - January 31st, 2022
AI Weekly Update - January 24th, 2022
Просмотров 2,5 тыс.2 года назад
AI Weekly Update - January 24th, 2022
Deep Learning for Search - January 15th, 2022
Просмотров 2 тыс.2 года назад
Deep Learning for Search - January 15th, 2022
Weaviate and Haystack
Просмотров 1,3 тыс.2 года назад
Weaviate and Haystack
General Purpose Readers
Просмотров 9072 года назад
General Purpose Readers
Binary Passage Retrieval in Weaviate (32x Memory Savings)
Просмотров 8442 года назад
Binary Passage Retrieval in Weaviate (32x Memory Savings)
Keras Code Search with Weaviate
Просмотров 8102 года назад
Keras Code Search with Weaviate
Healthsea from Spacy on HuggingFace Spaces
Просмотров 9642 года назад
Healthsea from Spacy on HuggingFace Spaces
Open-Source Deep Learning
Просмотров 1,5 тыс.2 года назад
Open-Source Deep Learning
Deep Learning in Context (Thoughts on OpenAI WebGPT and DeepMind Retro)
Просмотров 1,7 тыс.2 года назад
Deep Learning in Context (Thoughts on OpenAI WebGPT and DeepMind Retro)
Wikipedia Vector Search Demo with Weaviate
Просмотров 5 тыс.2 года назад
Wikipedia Vector Search Demo with Weaviate
Connor Shorten - Vector Podcast Interview!
Просмотров 3112 года назад
Connor Shorten - Vector Podcast Interview!

Комментарии

  • @B_knows_A_R_D-xh5lo
    @B_knows_A_R_D-xh5lo Час назад

    😊😊

  • @B_knows_A_R_D-xh5lo
    @B_knows_A_R_D-xh5lo Час назад

    😊😊

  • @colmmoore2409
    @colmmoore2409 8 часов назад

    Hey Connor, is there any place to learn Go based on what AlphaGo does? Can it teach?

  • @AJGLenio
    @AJGLenio День назад

    Very nice, thank you. Only the zooming and movement is kind of dizzyish and way to fast sometimes so I can't follow anything as you can't read or know where you are going. I think with the large pointer is enough to drive attention to it. Anyway, great vid and thanks again for the intro to DSPy.

  • @edmald1978
    @edmald1978 3 дня назад

    What we can do to have bigger answers? I want it to generate code, but after executing it gives me 4 lines of code Someone have some idea?

  • @fanchuankang1228
    @fanchuankang1228 3 дня назад

    Thank you. 😀

  • @rp77797
    @rp77797 8 дней назад

    Dude you mentioned weviate twice and didn’t even mention what the retriever does. If you want to do promotion, dedicate a segment to it. It will come across more professional and sincere without confusing viewers.

  • @Ujjayanroy
    @Ujjayanroy 13 дней назад

    @3:46, how can low reach to high with search action?

  • @NarotamDhaliwal
    @NarotamDhaliwal 14 дней назад

    🎯 Key points for quick navigation: Exciting new framework Programming model optimization Graph computation programs 09:55 *Signature, dock string* 10:10 *Prompt optimization, syntax* 10:38 *Input, output fields* 10:52 *Control flow, loops* 11:20 *UAPI, web queries* 12:26 *DSPy Assertions, suggestions* 13:49 *Citation attribution suggestions* 14:16 *Optimization, instructions, examples* 14:59 *DpY as PyTorch* 16:31 *Inductive biases, depth* 17:43 *Intermediate supervision, DpY compiler* 19:22 *Testing with programs* 19:35 *Optimizing instructions and examples* 20:03 *Automatic data labeling* 20:46 *Ending manual prompts* 21:14 *Adapting to new models* 22:49 *Structured output with prompts* 25:33 *Fine-tuning neural networks* 26:26 *Using few-shot examples* 27:51 *Bootstrapping rationales* 28:19 *Evaluating synthetic examples* Overlapping keywords metrics LM judge prompt LM produce metric 37:58 *Deep learning paradigm shift* 38:41 *Data set formatting* 40:03 *Inspect intermediate outputs* 40:59 *Add Chain of Thought* 43:35 *Define optimization metric* 45:13 *Value of reasoning* 45:28 *Inspect parameters* 46:25 *Multi-hop search integration* Queries connected to final answer Introduction to multi-hop search Supervision on intermediate hops Made with HARPA AI

  • @RichardHamnett
    @RichardHamnett 17 дней назад

    The recipe is gone

    • @connorshorten6311
      @connorshorten6311 17 дней назад

      Hey Richard! Sorry we refactored recipes! The links are now fixed!

  • @B_knows_A_R_D-xh5lo
    @B_knows_A_R_D-xh5lo 22 дня назад

    😊😊😊😊

  • @B_knows_A_R_D-xh5lo
    @B_knows_A_R_D-xh5lo 22 дня назад

    😊😊😊😊😊

  • @B_knows_A_R_D-xh5lo
    @B_knows_A_R_D-xh5lo 22 дня назад

    👏🏿👏🏿👏🏿👏🏿👏🏿👏🏿👏🏿👏🏿👏🏿👏🏿👏🏿👏🏿👏🏿😁😁👏🏿💯💯💯💯💯

  • @Meow-xm5kv
    @Meow-xm5kv 23 дня назад

    short and sweet, gets to the point. marvelous video

  • @thirukarthikanadar615
    @thirukarthikanadar615 23 дня назад

    Hi Connor, thanks for the awesome content. I have one small suggestion - Instead of covering maximum information, if it was topic by topic it would be more better. Example: In depth Information on 1 topic "Optimizers (formerly Teleprompters)". Thank you🙂

  • @B_knows_A_R_D-xh5lo
    @B_knows_A_R_D-xh5lo 26 дней назад

    😁😁😁😁😁😁 0:10 0:11 0:11 👀 0:13 0:13 0:13 👀👏🏿👏🏿👏🏿👏🏿👏🏿👏🏿Educational

  • @ThaLiquidEdit
    @ThaLiquidEdit 29 дней назад

    Is this notebook shared somewhere?

  • @B_knows_A_R_D-xh5lo
    @B_knows_A_R_D-xh5lo 29 дней назад

    🎉🎉🎉🎉🎉🎉🎉🎉😊

  • @B_knows_A_R_D-xh5lo
    @B_knows_A_R_D-xh5lo 29 дней назад

    😊😊😊😊😊🎉🎉🎉🎉

  • @ecardenas300
    @ecardenas300 Месяц назад

    Back on it again

  • @explorer945
    @explorer945 Месяц назад

    Do you laugh when you go in small tangents?

  • @B_knows_A_R_D-xh5lo
    @B_knows_A_R_D-xh5lo Месяц назад

    lets gooo 🎉🎉🎉

  • @djbracken2987
    @djbracken2987 Месяц назад

    Hey Connor, this is great content. Thanks for posting it.

  • @virtuous8
    @virtuous8 Месяц назад

    zooming in and out is distracting

  • @charismaowojoameh7681
    @charismaowojoameh7681 Месяц назад

    I tried the implementation but i keep getting the error "model not found"

  • @zhouyangbo4498
    @zhouyangbo4498 Месяц назад

    great intro, and any GitHub repository for it verification?if so ,will be greatly appreciated.

  • @actorjohanmatsfredkarlsson2293
    @actorjohanmatsfredkarlsson2293 Месяц назад

    Super interesting. But boy you move quickly through all this. It's really hard to follow at times.

  • @prashlovessamosa
    @prashlovessamosa Месяц назад

    Thanks

  • @dianaayt
    @dianaayt Месяц назад

    What metrics should i keep an eye on to know what to change to get better and better results? I'm trying to create the fake images to use for data augmentation, and obviously I want them as realistic as possible, but I honestly don't know which parameters to change for it to get better. Plus, i have 10 classes and I dont know if i should just change the same for all of them or just see what works for each. But, again, i dont even know how to make it better for even one

  • @tobkin
    @tobkin Месяц назад

    Two questions: - Why use gpt-4 instead of gpt-4-turbo for the teleprompter? - What are you using to make your pointer act like that?

  • @respair1385
    @respair1385 Месяц назад

    I always thought it was pronounced as D ES Pie. thanks for the deep dive btw!

  • @shawndeggans
    @shawndeggans Месяц назад

    great presentation!

  • @robboerman9378
    @robboerman9378 Месяц назад

    Thanks for the great content. One of the things I am missing is how to save the optimized program so I can use it after that without constantly re-training.

  • @MrjbushM
    @MrjbushM Месяц назад

    Thank you.

  • @NicolasAudioBooks
    @NicolasAudioBooks Месяц назад

    i'm getting a headache by the zooming-in and then skipping across the page.

  • @lakshaysagarrana3965
    @lakshaysagarrana3965 Месяц назад

    Connor be experimenting with video formats.

  • @stefanbuys1927
    @stefanbuys1927 Месяц назад

    This is almost exactly the same video as the one by Qdrant. Weird.

    • @ecardenas300
      @ecardenas300 Месяц назад

      Guess which one came out first... 🫣 It's super weird indeed

  • @PeterWilliams97
    @PeterWilliams97 2 месяца назад

    I ran your notebook and got the following error. print(RAG()("What is binary quantization?").answer) AttributeError Traceback (most recent call last) Cell In[7], line 1 ----> 1 print(RAG()("What is binary quantization?").answer) File ~/code/vector_search/weaviate/recipes/.wenv/lib/python3.11/site-packages/dspy/primitives/program.py:26, in Module.__call__(self, *args, **kwargs) 25 def __call__(self, *args, **kwargs): ---> 26 return self.forward(*args, **kwargs) Cell In[6], line 16 15 def forward(self, question): ---> 16 context = self.retrieve(question).passages 17 pred = self.generate_answer(context=context, question=question).answer 18 return dspy.Prediction(context=context, answer=pred, question=question) File ~/code/vector_search/weaviate/recipes/.wenv/lib/python3.11/site-packages/dspy/retrieve/retrieve.py:30, in Retrieve.__call__(self, *args, **kwargs) 29 def __call__(self, *args, **kwargs): ---> 30 return self.forward(*args, **kwargs) File ~/code/vector_search/weaviate/recipes/.wenv/lib/python3.11/site-packages/dspy/retrieve/retrieve.py:39, in Retrieve.forward(self, query_or_queries, k) 36 # print(queries) 37 # TODO: Consider removing any quote-like markers that surround the query too. 38 k = k if k is not None else self.k ---> 39 passages = dsp.retrieveEnsemble(queries, k=k) 40 return Prediction(passages=passages) ... 79 .do() 81 results = results["data"]["Get"][self._weaviate_collection_name] 82 parsed_results = [result[self._weaviate_collection_text_key] for result in results] AttributeError: 'WeaviateClient' object has no attribute 'query'

    • @connorshorten6311
      @connorshorten6311 2 месяца назад

      Hey Peter! Apologies we have upgraded the WeaviateRM to use the Weaviate v4 client, can you please try upgrading dspy with `!pip install dspy-ai --upgrade` ?

    • @connorshorten6311
      @connorshorten6311 2 месяца назад

      Can you please share any error messages as an Issue on Weaviate recipes? It might be easier to help debug there instead of RUclips comments.

    • @LyuboslavPetrov
      @LyuboslavPetrov Месяц назад

      @connorshorten6311 Please do update the video with accurate setup instructions. I have been fighting to get this running (DSPY + Weaviate + OLLAMA) for the past 2-3 hours to no avail. Tried multiple weaviate-client/server combinations, ran trough docker and standalone, configured, updated/downgraded dspy-ai. Went through so many help pages, cannot count now. I am tired, but still would like to play with this set of technologies. Thanks

  • @koljanos
    @koljanos 2 месяца назад

    Hey, what version of Weaviate-client you are using????

    • @connorshorten6311
      @connorshorten6311 2 месяца назад

      Hey! I am using v4 and the latest version of dspy-ai, can you please share any error messages as an Issue on Weaviate recipes? It might be easier to help debug there instead of RUclips comments.

    • @koljanos
      @koljanos 2 месяца назад

      Allright, will check the issues!

  • @PrathameshSaraf
    @PrathameshSaraf 2 месяца назад

    How can we get metadata that is associated with any chunk of docs

  • @cipritom
    @cipritom 2 месяца назад

    Is it me, or at least the last part is a digital avatar?

  • @catchychazz
    @catchychazz 2 месяца назад

    Great video, Connor. Have you tested out if SAMMO is better than DSPy for production?

    • @larsbell1569
      @larsbell1569 2 месяца назад

      I thought SAMMO was primarily prompt templating? Does it have some new features we are not aware of?

    • @catchychazz
      @catchychazz 2 месяца назад

      @@larsbell1569 No, you're right. I was working on the assumption that in production, you'd be using the most capable language models. At the risk of running token-heavy pre-compiled DSPy prompts, having a simpler prompt that automatically augments few-shot prompting only on specific user inputs/triggered events might be a more cost-efficient solution.

  • @dianaliu7543
    @dianaliu7543 2 месяца назад

    This is so different from RAG using GPT. Lots to learn

  • @leeme179
    @leeme179 2 месяца назад

    maybe just me but the blur/smooth filter to the face cam makes me suspect that face cam is AI generated 🤣🤣🤣🤣🤣🤣

    • @dixon1e
      @dixon1e Месяц назад

      Uncanny valley feel.

  • @Tarun_Mamidi
    @Tarun_Mamidi 2 месяца назад

    Is llama really OSS if we don’t know how or what it is trained on?

  • @human_agi
    @human_agi 2 месяца назад

    how to install ollama

  • @420_gunna
    @420_gunna 2 месяца назад

    this mf cookin

  • @VincentFulco
    @VincentFulco 2 месяца назад

    Would love to see an interface to groq please!

  • @LaHoraMaker
    @LaHoraMaker 2 месяца назад

    Dear Connor, that was the fastest release ever!

  • @emirhanbilgic2475
    @emirhanbilgic2475 2 месяца назад

    man, that's an amazing overview, thank you