Meta (Llama 2) vs Open AI

Using AI

11-01-2024 • 29 mins

On this episode: Llama, AI models, Weights Leakage, Comparison, Usage, Meta vs Open AI, Data management by Meta, Open Source AI, AI research groups, Instruction, fine-tuning, RLHF, Hosting Llama, AWS Bedrock, Azure AI Models, local finetuning, and guardrails, ChatGPT, GPT-4, GPT-3, GPT-3.5

Watch Using AI on YouTube (and see our daft AI-generated background images):

https://www.youtube.com/@genieai


Links:

  1. Llama Access Form (meta.com): ⁠https://ai.meta.com/resources/models-and-libraries/llama-downloads/⁠
  2. Llama 2 on Hugging face: ⁠https://huggingface.co/meta-llama⁠
  3. Llama 2 7B Chat on Hugging Face ⁠https://huggingface.co/spaces/huggingface-projects/llama-2-7b-chat⁠
  4. Meta uses copyright ignored books on AI training: ⁠https://www.reuters.com/technology/meta-used-copyright-ignored-books-ai-training-despite-its-own-lawyers-warnings-authors-2023-12-12/⁠
  5. Meta and IBM's Open Source AI partnership and it's lack of inclusion of OpenAI, Google, Microsoft: ⁠https://www.theguardian.com/technology/2023/dec/05/open-source-ai-meta-ibm⁠
  6. Yann LeCun's social media attack on OpenAI, Google, Microsoft etc.: ⁠https://www.reddit.com/r/technology/s/IumG20ZOKz⁠
  7. Model Weights Leakage: ⁠https://www.theverge.com/2023/3/8/23629362/meta-ai-language-model-llama-leak-online-misuse⁠
  8. “We have no moat” - Google AI researcher: ⁠https://www.semianalysis.com/p/google-we-have-no-moat-and-neither⁠
  9. Restrictions on using Llama: ⁠https://spectrum.ieee.org/open-source-llm-not-open⁠

Welcome to another episode of Using AI. I'm your usual host, Alex Denne, and today, I'm accompanied by Alex Pap and Nitish Mutha (Founder of Legaltech Genie AI).

We start by introducing Llama and discuss its weights leaking incident. We also elaborate how Llama compares to other AI models and explain how to use it. The conversation takes a turn towards the Meta vs Open AI dispute, shedding light on their differences and impact in this space. We also discuss Meta's data management and how it can actually come up trumps on both privacy strategy here, and non-copyrighted multi-lingual training data.

--- Send in a voice message: https://podcasters.spotify.com/pod/show/using-ai/message

You Might Like

Darknet Diaries
Darknet Diaries
Jack Rhysider
Fortnite Emotes
Fortnite Emotes
Lawrence Hopkinson
Double Tap
Double Tap
Accessible Media Inc.
The Vergecast
The Vergecast
The Verge
Hard Fork
Hard Fork
The New York Times
Waveform: The MKBHD Podcast
Waveform: The MKBHD Podcast
Vox Media Podcast Network
RNIB Tech Talk
RNIB Tech Talk
RNIB Connect Radio
This Week in Retro
This Week in Retro
Neil from RMCretro - The Cave, Chris from 005 AGIMA and Dave
Acquired
Acquired
Ben Gilbert and David Rosenthal
TechStuff
TechStuff
iHeartPodcasts
Smashing Security
Smashing Security
Graham Cluley & Carole Theriault