06-reference / transcripts

moonshots ep52 emad mostaque ai revolution transcript

Wed Jun 28 2023 20:00:00 GMT-0400 (Eastern Daylight Time)

[Music] by next year end of the year I believe you’ll have chat GPT on your mobile phone say that one more time by the end of next year you’ll have chat GPT on your mobile phone without internet today the world changes this is a regime change four of the top 10 app store apps in December were based on stable diffusion 41% of all code on GitHub right now is AI generated we have figured out how to make human scale so you have this amazing thing that can create anything how far out are you able to see can you have a sense of predict where we are in 10 years I can’t see possible ideas there’s enough fear uh and some of it is deserved but there also needs to be hope humans are humans bring them the information that creates the most value and you will change the world I’m excited to share with you one of the most extraordinary conversations I had at this year’s annual abundance 360 Summit it was with a friend someone I’ve had on this podcast before Imad mustak who’s the founder and CEO of

[00:01:00] stability AI you know his company from a number of his products including stable diffusion we sat down to talk about his moonshots to talk about how generative AI is changing the world what do you do if you’re a 20-year-old uh just getting involved or if you’re a seasoned CEO or entrepreneur and how is this going to change the world of Hollywood Education Health Care you know it was an incredible conversation I’m excited for you to hear you know my through this podcast is to help you hear the voices that are filled with optimism and abundance if that’s of interest to you then please subscribe to this podcast all right enjoy the episode and by the end of this episode you should have a pretty good idea where you stand on AI are you excited about it you fearful of it I’d love to know feel free to share your stance with me on Twitter hey pal how’s it going buddy uh listen I know you have so much going on right now

[00:02:00] uh it’s insane we’re in the midst of uh the most extraordinary period of of Technology ever and you’re in the thick of it yeah I think what’s it a good phrase is everything everywhere all at once yes yeah that’s Bally what it is yeah uh I can’t mention the conversations he’s been having the last 30 minutes but it would blow your mind uh I’m going to give you this clicker you have some uh some slides to show you know I think the very first uh question to ask ask is if you were going to sort of bring people up to speed on on where we are right now would you share some of what your thoughts are here we have figured out how to make human scale how scale that’s the most difficult thing um basically classical AI was all about taking stuff and extrapolating it we figured out how to figure out principles and latent knowledge with huge compression in these files as we’ll talk about in a bit like the most valuable thing you can have is a good e a a

[00:03:00] really good analyst I have Esther she’s amazing makes such a difference I’m sure all of you in this audience realized that right we now have that basically what we’ve done is we’ve trained these things on large amounts not huge amounts of data to understand principles and now when you use a gp4 it’s like a really talented intern analyst with a bad memory and we’re about to fix the memory and it knows how to pass the medical bar ex bar exam or medical licensing and others it knows how to draw beautiful pictures or create audio of any type and and it’s basically available to everyone for pennies and so we have to think what does that mean it can mean huge disruption or it can mean basically we’re at the point of utopia and abundance so if you don’t mind I’d like people know stable diffusion and you’ll show them the chart that really rocked me when I first saw it uh but what are the wide range of things that stability AI uh is working on right now where do you want to go um I that you can tell us about it please no I can tell you

[00:04:00] basically my aim is to provide the building blocks for a society OS every part of society if you have skilled experts in them our mission is to build the foundation to activate human’s potential and across every single modality we’re building models so audio video protein folding DNA chemical reactions language and others we’re doing it for every sector so youve got a banker GPT a board GPT to replace all your crap board members you know all the way down to National models so we’re doing an Indian national model at the moment an Indonesian one a Japanese one so that everyone can have a file that they put words in and images audio text anything pops out that’s appropriate to you to enhance you so I want to I want to click on that one because it’s very important uh people talk about biases in the system but what you’re talking about is creating like what you’re calling a foundational model that is biased to you or to your company

[00:05:00] or your country yes the existing internet has centralized artificial intelligence that guides our Attention our memorization where we go with this technology we can push internet intelligence to the edge so every single person country culture company can have their own AIS and that’s an amazing thing because it can work for you not against you right and so that’s the personalization because what is bias right there are inherent biases in our society and things but we can never move faster this’s the thing we can’t move FAS enough to address them but then what if you could have your own stories everyone here has a story everyone your members of a360 you believe in abundance you know there’s a whole variety of things that make us who we are have the AI respond to your own story and work for you and I think that’s the intelligent internet and that’s the amazing future we have coming that is and you built stability AI as an open platform yeah uh which is very different from everybody else y I mean uh it’s interesting right open AI has that name and very funny if you go to

[00:06:00] open.com it doesn’t go to open aai it goes to stable well actually open. a here oh open. a sorry yeah uh which is pretty funny so uh and appropriate cuz you are the open AI platform we are I mean actually open.com also works um but yeah I mean basically where we were was that we had this explosion of like research look at this is again exponential literal exponential of the amount of ml research that occurred when we like let’s build a generalized intelligence when open Ai and other startup we didn’t know how to do it and then we found this one thing called a Transformer that pays attention to the important things like you guys are paying attention to the important things that we’re saying right now as opposed to just treating everything the same and it figured out that we could scale it with these gpus gigantic supercomputers they didn’t know exactly how to do it so they just kept on adding more and more supercomputers and we’ve got a lot like our supercomputer is 10 times faster than NASA’s right our new supercomputer is 10 times faster than that again exponential but then they

[00:07:00] thought this solves everything scale solves everything but have you ever seen a generalized system that outperforms A specialized system no but that means you have to give people the tools to make it a specialized system you’re never going to send all your internal company data to chat GPT or gp4 so that’s an interesting point um and I don’t know if I heard it from you or elsewhere where some of the banks and large corporations are not sending uh their data and allowing employees to use chat GPT they don’t want Microsoft having access to it so what’s the alternative how do you how do you go around that we have the most popular language models in the world gptj neox 25 million downloads and we’re about to release our next Generation open source models again base models and then you’ll have the banker board versions Indian versions so I get to use it on my own system that no one else has access to you get to go is it via Amazon Google Intel anyone on Prem in your Cloud you own it again it’s like you basically it’s like actually one thing it’s like again these are like very

[00:08:01] talented analysts getting an analyst on Su conment from Microsoft who goes back to Microsoft versus hiring your own analyst right these are the two modalities so you’ll have these big private proprietary models where results of secret source and they have these open interpretable models where you see how the how the cookie is made as it were that you own and I think the latter is far more powerful than the former because you don’t need a model that does everything then you give people the tools they need and the ownership to create their own experiences and accelerate themselves let me ask you you know we’re all here trying to understand where this is going how far out are you able to see can you have a sense of predicting where we are in 10 years 5 years I can’t see past 5 years you can’t see past 5 years no because by next year end of the year I believe you’ll have chat GPT on your mobile phone say that one more time by the end of next year you’ll have chat GPT on your mobile phone without internet wow so we talking about so yeah and is it a a stability chat right yeah

[00:09:02] stable chat stable chat let’s name it properly so uh incredible because you’ve talked about taking how many terabytes of data down to a couple of gigabytes So like um actually this is probably one thing that I wanted to talk about quickly for the easiest way for us to communicate has been speech it’s what we’re doing now text has been harder but you’ve seen with chat gbt it’s not easier you just ask it to rewrite your kind of emails and with Office 365 and works do that and visual was the hardest these have all been flattened by this technology now so we can communicate anything but the technology behind it as you said was a bit crazy to do this what we did so stable diffusion was our text to image model we were like do we do it big and do loads of layers or do we make it accessible and we were like accessible so we worked super hard Manhattan Project and we took a 100,000 gigabyt of images 2 billion and created a 2 gigabyte file that can generate anything okay let’s let’s slow that down because the meaning of that is is insane

[00:10:00] how many terabytes was it it was 0.1 100 terabytes 100,000 gabes and the output was a 2 GB file that can create anything and that 2 gbes is you know sits on your phone your laptop in your brain it was the whole stack so intelligence is compression you’re going to go away from this event and you’re going to compress the things that you learn and have te takeaways right that’s what we do and that’s what these machines do now but again it’s a single file four of the top 10 app store apps in December were based on stable diffusion and it was the entire stack a single file of Weights of numbers that’s extraordinary words go in images come out and this the same chat GPT is a single file actually it’s a couple files but they say it’s a single file words go in code comes out amazing essays come out so this is something a bit different and again it’s like again you’ve taught an analyst just about about everything

[00:11:00] or it’s an artist the analyst and things like that I think we’ll get it down to 100 megabytes huh and it went insane because we made it like that so this is I think this is what you texted me and I said huh so um you know a lot of us were doing web 3 and we were all like developers developers are cool right uh in 3 months we overtook Bitcoin and ethereum and developer popularity so on the bottom here is the years and on the axis on the y axis here is the number of uh GitHub developers GitHub Stars yeah developers who love it and so when I when you sent me that I thought that was the AIS line yeah so cumulatively the whole ecosystem built around this thing which is a bit like a game engine has overtaken Linux again Linux 20 years this five months because we gave it to everyone and it runs on your MacBook on your iPhone without internet so you have this amazing thing that can create anything and I think that’s profound right like so we’ve seen

[00:12:04] the profound indeed we’ve seen the speed just explode can we expect it to get faster and faster yeah I think you can so look words go in images come out a lot of you have kind of seen this you can generate anything but since the release in August we’ve sped up 100 times wow we’ve gone from six segments in image to 60 images a second and the quality has improved and basically the next version is photo real istic so 60 images per second is like video yeah we pretty much got video so my question is is Hollywood scared shitless or they excited they’re scared it’s a mixture there’s a few people who are scared shitless and we’ll talk about some of the stuff coming down the pipeline later cuz you know Peter and I had a discussion like should we scare everyone shitless completely or should we kind of do hope and so I’m going to do hope actually I think I’m going to focus on this this is the most disruptive thing ever because again humans can scale so you don’t need as many humans there was an MIT study I think I’ll send it to you just came out it showed that basically the third to

[00:13:02] the seventh desile got like 30% better the top 5% got orders of magnitude better or multiples better with this technology and so it lifts humanity and the ability to communicate and do things so this is the hopeful future I that we share and the abundance mindset um that I think is really important for people to take away there’s enough fear uh and some of it is deserved but there also needs to be hope I think I think we always have to look at the unchanging between versus the inevitable so an inevitable is 41% of all code on GitHub right now is AI generated wow to 6 months chat GPT can pass a Glu level three programmer exam and it will run pretty much on a MacBook or that’s this year this year right now yeah there are no programmers in five years no programmers in 5 years so those of you with kids who you are having you know with python lessons and so forth maybe it’s instead helping them to understand

[00:14:02] uh how to ask great questions or give great directions or prompts yeah like with this this is a technological Marvel that we sped up 100 times because we have amazing developers and we have communities of hundreds of thousands I went to gp4 and I said help me write some code to change the nature of inference from something called int 8 to int4 which is only a year old so it’s not in the data set and it figured out and it worked figured out awesome straight out I asked it to create asteroids in D3 we the high school thing Y and I copy past it it work the game straight out so again we have to kind of think about this and we have to think but what can you do well the answer is you can do anything now because a lot of the stuff that blocked you isn’t there anymore any of you can now be creative any of you can now build systems and so you build the systems that adhere to the unchanging demands of people to make their lives better and that’s value and they’ll pay you for that value we’re all creators and we’re in fact all we had Will I Am last night at our our Patron

[00:15:01] dinner who’s just this incredible Creative Energy across all modalities and all of a sudden you’re not restricted by what you learned in school you can bring the best to anything you desire the best to anything desire you can control it so you can just say like you know take something and change it to its original form you know like this you know I’m at from mindset to materialization which version of you do you like best I don’t know exactly and this just with words so there’s no more prompts I just say I want to change it to this or that and it happens instantly now with a new version yeah you know you can say let’s do Dynamic adaptation again it happens in one second you generate all of these variants you know and you don’t need those prompts people say like there’s all these magical spells you don’t say that you say I want to turn Woody into a still from a western right or a place of fruit with cake so it also becomes more natural what are interfaces in the future interfaces are nothing it’s all about human extension and it’s about

[00:16:02] information theory is at the core of all computer science information is valuable in as much as it changes of state now we finally have a friend to be with us all the time that can bring us the most valuable information and the most valuable State changes you’re a 20-year-old uh on our Zoom audience here or in the room or 23y old and you’re trying to decide what to do now uh what is your advice you just throw yourself 100% into this it’s the biggest change in society ever it’ll be more disruptive than the pandemic in the next year or two and I led the United Nations a initiative against covid-19 kayak you know helping organize the world’s Co knowledge and making accessible and useful yeah so I saw that coming um it’ll be for positive and negative because you can do things that could never be heard of as an example we have an upscaler it goes from 128 pixels to 4K in 1.5 seconds back to that that’s amazing what can you do with that this is the thing you are given now the recipes and tools

[00:17:01] what can you do so there’s going to be a th000 companies spending $10 million each this year I spoke to one of the big four accounting firms they were like do we need Auditors anymore I’m like probably not as many right and then they said okay we’re going to spend $300 million in the next two quarters trying to figure this out but that’s times many many firms everything everywhere all at once and again this is the nness we’ve seen this type of thing happen like with a Silicon Valley Bank collapse yeah our societies become more and more connected we’ve talked about expert system I mean how long have we talked about expert systems for yeah a bit yonks they’re here now right and again this is why you can do these crazy things like why don’t you create your own studio so how do we play this um we play this video you speak and IM magically happens play there go this is a video rock paper scissors that was done using our technology by two guys in like 4 days and it’s a whole 7-minute video at this level of

[00:18:00] quality that’s all you need so why not create amazing kind of videos and things like that but we’re going to get to a point soon enough and I’ll ask for your prediction where I can say I want a movie about this theme 90 minutes long starring my favorite stars um how when do we see that a personalized movie I think you get there in the next couple of years like rock paper scissors 2 again look it up on Google will be five times as fast and the next version will be fully generated by putting a script in I mean like this one if you press play and it automatically generates a music lyric vide unfortun we don’t have sound uh but you can go on deep Floyd AI on Twitter and see it automatically generated kind of this music lyric video you know just from a song input with the entire kind of style of this as well so everyone here as a filmmaker everyone I mean for me we have a common passion in disrupting and Reinventing education yeah uh where I can have in a virtual world uh learn about anything I want a time machine to go and have my favorite

[00:19:02] you know characters teaching me about what anything I need um and that’s two years away yeah I mean that actually might be here right now I mean again kind of you’ve seen glasses 3E 3D displays and all sorts of crazy things but one of the things with this this is contextualization because again we are the stories we make so one of the things we’re working on that’s quite fun is can you make remake Game of Thrones as a j drama from Korea so you imp and the characters turned Korean right W I’m also trying to get George R Martin and HBO to let me remake Game of Thrones season 8 cuz it was terrible uh uh yeah and actually it’s very interesting why because Game of Thrones season 1 to 7 everyone had agency and the meaning was in the interaction between our stories of the characters whereas the last one tried to get us to an ending and so it felt so disjointed so I’m like I’ll help you write your book we have the script writing AI coming out and a looked writing AI coming out and so we can tell better stories that are more empathetic and engaging because again this is more engaging for the thing you can customize

[00:20:01] your thing everywhere you can customize to every learner how crazy is that and all at once new theme let’s imagine you’re in the audience here you’re a business owner uh entrepreneur CEO and uh what do you do next I think what you have to do next again it’s kind of what you said you need to have a dedicated there’s nothing more important in your entire business than this yeah so I want to that right today the world changes electricity is made available the telephone is made available internet’s made available and this is all of those things together all at once everywhere yeah this is 5G this is bigger than 5G over a trillion dollars went into 5G more will go into here actually I’ll give you an example because again it’s always the unchanging versus the inevitable right I gave the whole of stability AI the week off at the end of the year cuz I was like holy crap you’re doing a lot right cuz we do everything right and we do it with we have 150 people yet we do every modality cuz we

[00:21:01] have the power of community and open behind us setting the standard so I give the whole team the we off said go to sleep turned off all the things cuz you’re going to die if you don’t get some rest so of course business decided covered that stability AI CEO Amad mustac competitor to open their eyes says you’re all going to die in 2023 we might me make press as well what can I say um but then what happened is you know I was just chilling and I got like five calls from head masters of UK schools emad what’s our generative AI strategy what all our children are using chat GPT to do their homework essays I was like don’t set homework essays get good so again homework is never the same for every teacher all at once and so you have to look at your industry and again what will not be the same when you have the ability to scale humans yeah this is the question that you have to ask yourself like an eaten now Bas of British educ ation they do their essays

[00:22:00] live by hand because I told them to do that cuz I went to Westminster who I told to embrace the technology right so again it’s as Peter says there’ll only be companies that Embrace a and those who don’t um I think the way that it pirs out because I was a hedge fund manager invested tens of billions of dollars you know like I understand markets as well is that if you are in something that’s a sou company you’re going to have to really think hard because um gbt 4 for example and again will have our equivalent of that but we’re taking a different approach Of Swarm intelligence versus General has a 32,000 token context window which means you can feed it 20,000 words of instructions well what do open a ey at right now that that’s their one gp4 the one that they open AI is the best language mod you should use open Ai and you should use Arm models coming up as well private data and general data hybd AI you know um but that means you can basically tell all of HR instructions for something like workday what does workday do then H because it can be replaced by a single

[00:23:00] 200 megabyte file which you can query on your laptop or your phone well yeah eventually but not now but doesn’t matter it cost like $2 for query right right I mean it’s insane so but then you have to think if you’re in a regulated industry you have supernormal margins you know if you’re in a creative industry again you can basically either embrace it to have higher Revenue cheaper costs or not like I give you an example one of our movie director um did day film called actually I can’t give you an example let’s just say millions of dollars are being saved at the moment using this technology and again you just have to really think through it Ed and go going back to our audience here who you know use technology but don’t have ai embedded in their DNA uh I’ve shared the idea of having a chief AI officer who’s really a strategist for you because you’re not building your own AIS you’re deciding which platforms to use right yeah and again a fair few companies will build their owni so I think it’ll just be Google Microsoft open ey and us that build the foundation

[00:24:00] models that everyone uses you don’t need to cuz again it’s like we’re the universities churning out the most amazing graduates effectively you know some of them you can borrow and they’re specialized by those guys and some of them you can hire yourself through your gpus or kind of whatever my suggestion is that that what’s the but the thing is how do you find that person H you know until they’re nii no how do you find that person advice the advice is you need to First find someone who pass about this because this is so new so one of the things that makes us different is that we’re community- based organization we came out of a community so we have developers one of them was an Amazon warehouse worker last year and taught himself had a code nice another one’s a 19-year-old 50 year PhD with three graduate degrees you know clear it’s not going to be the person who is traditionally the person you would think about it is driven by Passion it’s driven by Passion everyone here understands the importance of passion and passion is what you need for this because this is a regime change it is not more of what came before so you have to throw yourself in it and have that

[00:25:01] flexibility of mind and the key thing is can it bring you what the next thing is for your industry you know hey everybody this is Peter a quick break from the episode you know I’m a firm believer that science and technology and how entrepreneurs can change the world is the only real news out there worth consuming I don’t watch the crisis News Network I call CNN or Fox and hear every devastating piece of news on the planet I spend my time training my neuronet the way I see the World by looking at the incredible breakthroughs in science and technology how entrepreneurs are solving the world’s Grand challenges what the breakthroughs are in longevity how exponential Technologies are Transforming Our World so twice a week I put out a Blog one blog is looking at the future of longevity age reversal biotech increasing your health span the other blog looks at exponential Technologies AI 3D printing synthetic

[00:26:00] biology AR VR blockchain these Technologies are transforming what you as an entrepreneur can do if this is the kind of news you want to learn about and shape your neural Nets with go to demand.com back/ blog and learn more now back to the episode we share a moonshot um in education I’ve had the ability to support to some degree what you’re doing uh just chat one second about your your vision on Malo yeah so um you know uh X prize for learning fantastic prize by Tony who’s here next week tomorrow I think and then Elon Musk for the first appp that could teach literacy and numeracy in 18 months without internet we’ve been deploying that into refugee camps the winner of that um all around the world from ringa to Malawi to Kenya and we’re teaching 76% of kids literacy and numeracy in 1 hour a day in 13 months in the worst places in the world with adaptive learning yeah give it up for go that’s been the core of imad’s uh

[00:27:01] passion and moonshots but he’s taking it a step further taking a step further because by doing that this is without AI so we’re working with the malawian government as the first example we’re feeding 30% of all the kids in Malawi we’re going to go to 100% and give every child in Malawi their own AI I want to call it one AI for child but I’ve been told not to um and that’s kind of with our charity imagine worldwide um but then we’ve built a special type of bond with the World Bank and s whereby you put down $20 million you only pay if a million kids are prbly educated and so we’re going to use that and the World Bank pays up front and then you can have it in your pension fund and see how a million kids are doing we’re going to use that to scale these tablets plus highspeed Internet in every school to every child across Africa nine out of 10 kids in Africa cannot read and write a sentence by the age of 10 what happens when they all have their own AI that works for them that’s in his intelligent and strategy PT and Healthcare on that tablet yes the AI teaches the the kids learns from the kids and that will also create the

[00:28:00] national models for every country right now we hold the eyes open of the AI and we teach the whole internet which is why it goes a bit crazy you know and again we use reinforcement learning and other things to guide it this will be different so that technology scales again there’s nothing more as impactful as onetoone tuition and now we can do it in an empathetic way that adapts to each child I believe that we can also address things like dyslexia and other things so it’s just information processing and you will see that coming we’re doing a big drive towards that any information processing issues will be solved by this are you an auditory learner visual learner there are no more interfaces so it’s completely customized learning for the individual their favorite color sport star way of learning modality knows exactly where they are and where they need to go building the foundation to activate Humanity’s potential and so we’re going to open source on new language models uh in a next month and then we’re going to announce the next generation of this an open model for all of the world that you Des deserve for education and healthare other things cuz humans are humans bring them the

[00:29:01] information that creates the most value and you will change the world is this going to revolutionize Healthcare to the point of yes let’s give it up for mod on that one yes we got just two minutes left here H and then you’re coming back for the Q&A which will be the fun part because the audience gets to participate uh I’ve always talked about the best diagnosticians the best Healthcare is going to be AI which is going to level a playing field the poorest child the wealthiest child same level across the board yes humans are humans this is why I kind of did the kayak project lot what a great advantage that is it’s a huge advantage and again this is the thing this is the great equalizer or it’s the great controller which is why I’m open versus closed yes this cannot be controlled by any entity we have to distribute this cuz I believe this is a human right it’s the next element in the evolution so speaking about that uh we’re in the

[00:30:01] middle of the AI Wars and uh uh little rumor told me that you got kicked off LinkedIn today yeah they identified our website as malware first last week and then made all our job description today we got who owns LinkedIn by the way I can say oh Microsoft so it’s going to be very interesting the stakes are really high um so there’s a lot of people that don’t want this technology to go out to the world again think putting it on these tablets for all these kids building a national mold to everyone again our mission is to build the foundation to activate Humanity potential and our motto is not don’t beit make people happier and the happiest you can be is when you have agency let everyone have their own agency and they create insane things on that note let’s give it up premodern [Applause] [Music] Scot oh