Announcement

Collapse
No announcement yet.

Hollywood is on strike because CEOs fell for Silicon Valley’s magical thinking

Collapse
X
 
  • Filter
  • Time
  • Show
Clear All
new posts

  • Hollywood is on strike because CEOs fell for Silicon Valley’s magical thinking

    This columnist makes some interesting points.

    https://www.latimes.com/business/tec...gical-thinking

    In one respect, the actors and writers of Hollywood uniting on the picket lines in a historic, industry-shaking strike is a tale as old as time: one of workers fighting bosses for better pay. Yet the reason this battle is shaping up to be so uniquely intractable and momentous — as you might have gathered from all the headlines about artificial intelligence and streaming economics — is very much of our moment.
    But it’s not, ultimately, technology that’s at the root of the problem. It’s that the studio executives both new and old have embraced the powerful — and ultimately disastrous — magical thinking pumped out by Silicon Valley for the last 10 years.
    Studio heads are touting the disruptive properties of digital streaming, the transformative power of AI, a brave, unpredictable new world for entertainment writ large — and how writers and actors must adapt to this new future. But just as it did when it was issuing from the tech sector during the 2010s, this talk too often amounts to a smokescreen that lets executives and investors line their pockets and risks leaving workers holding the bag.



    Company Town
    Writers’ strike: What’s at stake and how it could disrupt Hollywood


    As the contract between the Writers Guild of America and the Alliance of Motion Picture and Television Producers expires, a strike has been called.




    “These companies blew up a successful business model that the public enjoyed, that was immensely profitable, and they replaced it with a mishmash that we have now,” Adam Conover, the star of “Adam Ruins Everything”and a negotiating committee member of the Writers Guild of America, tells me. “And now, they’re refusing to update the contract to reflect those changes.”
    We’ve heard a lot about the ways that studios want to reserve the right to use AI — to create endlessly usable digital replicas of actors, to generate scripts that writers will be paid lower rates to fix up. We’ve also heard about the new economic picture ushered in by streaming, about an industry in the throes of change, and the necessity of belt-tightening as a result.

    We’ve heard Disney Chief Executive Bob Iger saying the demand by the Screen Actors Guild for fair payment in the new digital landscape “isn’t realistic,” and heard how Netflix saw declining user sign-ups and stock prices last year. Yet Iger reportedly makes $27 million a year, while Netflix just raked in $1.5 billion in net profit in the last quarter.
    So what’s really going on? And how did we get here?
    First, we need to understand why the 2010s may well come to be remembered as the great decade of magical thinking for Silicon Valley. Drunk on a truly transformational first decade of the 21st century — one that saw Google, Amazon, the iPhone and social media storm the world stage — flush tech investors turned their sights toward the next generation of startups, eager to see them do the same.
    The formula for seeking out that next multibillion-dollar “unicorn,” in hindsight, was pretty simple: The next wave of startups had to promise that it would disrupt a stale industry with a newer, high-tech, app-driven alternative, promise the potential for vast scale and promise that it could do so fast. So we saw the rise of Uber and Lyft, each of which vowed to revolutionize transit, and we got the likes of WeWork, which set out to usher in the future of co-working, and Theranos, which would do the same for at-home blood testing.






    Company Town
    What to know about the SAG-AFTRA actors’ strike


    Learn which jobs are impacted by the SAG-AFTRA strike, which movies and TV shows have shut down and where actors can get help.




    We know how it ended. Uber and Lyft have never been sustainably profitable, WeWork collapsed dramatically when it became clear that it was merely a wildly over-leveraged real estate company, and Theranos’ futuristic medical technology was outright fraudulent.
    Unlike many of the 21st century’s first-wave tech companies and products, which found both markets and roads to profitability, these were pipe dreams, propped up by a fire hose of investment cash, big-talking founders and the very real — and at the time, quite understandable! — sense that Silicon Valley was the place that determined how the future was made.
    As the 2010s began, Netflix sat somewhere between the old guard and the new. It introduced online streaming in 2007, and had a real product with real demand, as well as an established business in its DVD-by-mail rental service. Yet its ambitions were hypercharged by a newfangled sense that it could disrupt the old school Hollywood industry and scale endlessly — there was no reason everyone in the world with access to a screen couldn’t subscribe.

    Big-name investors sank hundreds of millions into Netflix’s new vision. As it began producing original content in 2013, it applied a distinctly next-wave Silicon Valley ethos. It would make massive upfront investments, bankrolling huge productions such as the David Fincher-helmed, Kevin Spacey-starring “House of Cards,” elbowing its way into the prestige TV pack, promising not only to compete but also to do it better: It would offer all the episodes at once, on demand, and viewers could consume them whenever and however they wanted. Cable would become obsolete. The future was cutting the cord.
    As with Uber and Lyft, whose bottomless chests of venture capital allowed them to conquer new markets once dominated by stodgy old competitors — in their case, the taxi cartels and livery cab companies — price was no object.



    Technology and the Internet
    Column: Your boss wants AI to replace you. The writers’ strike shows how to fight back


    Artists, journalists and screenwriters are leading the fight against employers who would seek to replace them with the products of ChatGPT and other generative AI software.




    Right out the gate, episodes for original Netflix shows such as “House of Cards” and “Orange Is the New Black”cost $4 million a pop. (So did episodes of shows that few remember today, such as “Hemlock Grove.”) The spending was profligate — it soon rose to rates of $15 billion a year on new content — but as it did for the magical valley startups, the strategy “worked.”
    “What happens is Netflix becomes the Wall Street darling, and all these other companies,” like Amazon, Disney, Apple, HBO, Paramount and NBC, “race to adopt Netflix’s business model,” Conover says.
    Herein lies the trouble. Amid this boom, which for a few years ushered in a gold rush for writers and talent, Netflix et al. adopted another key ingredient of Silicon Valley’s approach: secrecy. Data about shows’ performance and viewer habits were kept proprietary; we knew only what the streamers wanted us to know. That went for customers, performers, writers and for investors. Streaming is an inscrutable black box, about which so many stories might be told.
    It’s a sticking point in the negotiations — actors and writers on streaming series want a better way to calculate the value of their work, given that the residuals they earn are so much lower than for network or cable shows. The studios have resisted. “The reason nobody really wants to open the books on this is because if Wall Street got a look,” one Hollywood insider told New York Magazine, “they’d have a collective stroke.”
    What we’re seeing now is the fantastical thinking that Netflix and its followers could continue endless expansion running up against the physics of the real world — there are now 238 million Netflix subscribers, but those numbers dropped for the first time last year, and the company had to claw them back by nibbling at the corners, cutting off password sharing and launching new, cheaper tiers that run ads.



    Company Town
    Who’s on strike in Hollywood? Roll the credits and find out


    Here’s a breakdown of who is and isn’t walking the picket line.




    The boom times are over. Executives know it. Wall Street knows it. And the story that we’re in a revolutionary moment of technological transformation will run out of gas soon. So the bosses are using that moment to do what Silicon Valley wound up doing when its other big swings didn’t pan out: squeeze labor.
    Just as Uber and Lyft, which promised drivers rich rewards and flexible fares, started reducing rates and making it harder to earn those rewards, Netflix and the streaming cohort cut in its mold are now trying to square their promises of world conquest by slashing worker pay under the fog of magical thinking.
    It’s been noted, and correctly so, that entertainment industry labor disputes often erupt when there’s a change in technology — from theaters screening projected films to the cathode ray tube of the home television, say, or the rise of YouTube and other online content in the 2000s — and that happens for a reason. Historically, executives and management use a disorienting new technology to try to justify lowering wages of their workers, and they have done so since the days of the Industrial Revolution.
    “The old CEOs knew they had to work with the unions, bargain with us,” Conover says. “The new ones don’t. So part of the point of the strike is us as labor showing the tech CEOs that no, you actually do have to deal fairly with the unions.”

    Conover notes that it’s jarring to see the streamers plead poverty as an excuse not to negotiate with talent in good faith, given that show budgets and profits have both gone up.
    “Netflix lied to the public and Wall Street,” he says, telling them, “‘you can watch every show ever made in perpetuity, with no ads, for $15.99 a month forever.’ That’s like Movie Pass” (the much-hyped app that allowed users to see unlimited movies for a monthly fee, before quickly going bankrupt). “That’s ludicrous.”
    Ludicrous if you want to pay the people who actually create those shows for you, anyway.
    What Netflix and the streamers are trying to do now is seal in a new standard under which writers and actors are treated in much the way that Uber and the gig app companies treat their independent contractor drivers.
    “Uber is a perfect example,” Conover says. “Its drivers need to supply their own cars, their own gas, their own insurance and so on.” The drivers are on their own, with few to no benefits or protections, and are expected to maximize profits for the company. “And Netflix is trying to do the same thing.”



    Technology and the Internet
    Column: The real aim of big tech’s layoffs: bringing workers to heel


    Wildly profitable tech companies are citing an as-yet notional recession to make deep workforce cuts. They may have another agenda.




    Unlike Uber, Netflix really is quite profitable. But in order to sustain the mythical levels of growth it has promised investors, it is turning to similar tactics — cutting workers’ hours, making work more precarious and unpredictable and reducing pay. It’s a far cry from the sleek, automated futures promised by the studio executives.
    As with the biggest companies of Silicon Valley’s magical thinking era, it’s often hard to parse whether the ones touting the game-changing technologies themselves even believe in these visions — do studio execs really think consumers want to watch a parade of digital replicas of their favorite actors parroting lines from an AI-generated script? Or are they simply aware that the mere threat of such a future gives them leverage and power over the workers of today?
    In the end, the answer is immaterial. Silicon Valley’s invasion of Hollywood brought with it science fictional notions of growth for the industry, a penchant for secrecy and unaccountability and the expectation that it could get away with treating workers like robots or invisible code. We’re seeing what happens when those notions meet, for one of the first times, with a powerful, organized resistance.
    Personally, I’m hoping this one gets a Hollywood ending — and not the ending so many Silicon Valley startups got over the last 10 years.


  • #2
    The studios have resisted. “The reason nobody really wants to open the books on this is because if Wall Street got a look,” one Hollywood insider told New York Magazine, “they’d have a collective stroke.”​
    If the Hollywood insider is right, then sooner or later there is going to be a Silicon Valley Bank moment for Netflix, Disney+, or at least one of the other big streamers. You can only hide a chronically loss-making business from investors for a finite length of time. Disney+ is an interesting one: it lost hundreds of millions again in the last quarter, but Iger's line is that this is part of the plan, and that it will start to show a profit in (IIRC) Q1 of 2024. He's obviously managed to convince his board, because they just extended his contract for another two years. But it doesn't, I wonder if that will be when the house of cards starts to fall?

    Comment


    • #3
      That's funny, two years ago they said it would be profitable in 2023. I guess if they cut enough production costs and jobs, they'll get there, if they can do it without losing too many subscribers.

      When I first heard about Disney+, I thought, wow, that'd be cool to have access to all of Disney's classic films. But then after it debuted, I realized I hadn't been sitting around wishing I could see those movies. Then a friend offered to share his D+ password with me, because they hardly ever use their account. So I looked at the menu, watched a few of the "behind the scenes" featurettes about the Disney parks, found out that those are mostly puff pieces without a lot of great content, and haven't really been back since. Turns out I'm still not sitting around wishing I could see all those old Disney movies.

      Comment


      • #4
        kinda ironic...the amazon strikers dont have the union printers label on their signs...they must have used non union print shops!!!

        Comment


        • #5
          "the amazon strikers dont have the union printers label on their signs...they must have used non union print shops"

          I'm not there so I can't got and inspect them, but the signs in the article image sure look like they have a union logo. I can't think of any other logo that would be on there, and other images I've searched have a similar small oval logo with unreadably small text on printed signs..

          Comment


          • #6
            Originally posted by Mike Blakesley View Post
            When I first heard about Disney+, I thought, wow, that'd be cool to have access to all of Disney's classic films. But then after it debuted, I realized I hadn't been sitting around wishing I could see those movies. Then a friend offered to share his D+ password with me, because they hardly ever use their account. So I looked at the menu, watched a few of the "behind the scenes" featurettes about the Disney parks, found out that those are mostly puff pieces without a lot of great content, and haven't really been back since. Turns out I'm still not sitting around wishing I could see all those old Disney movies.
            Disney+ is great if you have a bunch of young kids... at that price, it's an unbeatable surrogate nanny... at least for a while...
            Disney+ would've been great if it actually featured all of the Disney, Touchstone, BuenaVista, and Fox back-catalogues, but many of the stuff isn't even there. Especially the Fox stuff is completely underrepresented.

            The last thing I watched on it is Andor, the only Star Wars show of all the new crap they put out there I actually found to be watchable, afterwards, I let my account lapse.

            What Disney fails to realize is that their companies are based on a different premise than the likes of Netflix. Disney used to be about quality first, not quantity. Netflix's business model is to keep you on the hook at the lowest common denominator. Binge-watching is practically synonymous with Netflix... So, Netflix's entire business model is about producing (relatively) cheap, sequential content en-masse. Netflix producing a high-quality movie can be considered a rare accident, rather than something happening on purpose and most of what they produce naturally ends up to be series, of which many don't even survive a second season.

            Disney's original business model of creating high-quality experiences and content and by leveraging artificial scarcity, in order to make that content more desirable doesn't fly if you offer everything at a fixed-price all-you-can-eat buffet that's open 24/7 and offers breakfast and lunch all around the clock...

            As for the Generative AI thing: It's coming and it's unavoidable. As a writer, learn to live with it. Learn to use it for your advantage. Learn to be much more productive with it. For now, generative AI is just a tool, use it and use it wisely. Me, as a moviegoer, don't care if the story was written (partly) by an AI, neither do I care if the actor was real or not. For me, only the end product counts. Right now, most of what Hollywood delivers is shit, so I actually hope they're going to employ AI to fix it for them.

            Comment


            • #7
              Yeah, it would be great if the AI writing machine had a plot adjustment where you could turn up the comprehensibility. Marvel needs that.

              Comment


              • #8
                b'gosh dave i just enlarged the pic above and at least the yellow signs appear to have the printer logo!

                Comment


                • #9
                  Originally posted by Mike Blakesley View Post
                  Yeah, it would be great if the AI writing machine had a plot adjustment where you could turn up the comprehensibility. Marvel needs that.
                  Here's the thing, if I understood the Google scientists who were interviewed by I believe Scott Pelley, they admitted that the AI systems they are working on can be given very little basic information about a what the programmer wants the AI to use in a story and AI will create a story based on it's knowledge and seeming "understanding" of the concepts and bingo -- a full-fledged, fully fleshed-out story will be created. If you watched that piece on 60 Minutes, you will see Pelley stunned and speechless at the results. And we are just at the dawn of this technology which one of the scientists claimed to have just as significent an effect on the human condition as did the invention of fire.

                  Seem that such a technology would be able to be given element for a story and also told, NO elements from the effin Marvel "Universe"... no car chases and no explosion and it can't look derivative of anything else from anyone else's effin "universe." Since we humans can't seem to be able to do that, maybe we are better off letting AI do it.

                  One of the other shocking points in that interview was when Pelley asked, "How does the AI do this? And the scientist calmly answered, "WE DON"T EXACTLY KNOW," Scary enough for this lad. Anybody remember COLOSSUS: THE FORBIN PROJECT? And about a dozen other Sci-Fi movies?

                  Comment


                  • #10
                    Originally posted by Frank Angel View Post
                    Here's the thing, if I understood the Google scientists who were interviewed by I believe Scott Pelley, they admitted that the AI systems they are working on can be given very little basic information about a what the programmer wants the AI to use in a story and AI will create a story based on it's knowledge and seeming "understanding" of the concepts and bingo -- a full-fledged, fully fleshed-out story will be created. If you watched that piece on 60 Minutes, you will see Pelley stunned and speechless at the results. And we are just at the dawn of this technology which one of the scientists claimed to have just as significent an effect on the human condition as did the invention of fire.
                    We run our own AI model in our basement, based on some of the open models out there. It requires quite some beefy hardware, but nothing near what ChatGPT uses. It's clear that the time for untalented, half-assed writers that just write boilerplate crap is over, they now have been replaced by a computer, which, probably is a good thing, because this computer is better at their job of making crap up. Let me give you an example:

                    Originally posted by AI Chat interaction
                    Q: I didn't quite like the last three Star Wars movies, those with Rey in it. Can we pretend they never happened and can you come up with a better story without Rey and not another Death Star. Let's pretend we're quite far in the future, Luke Skywalker and his friends are long dead and their adventures are legends now. Please come up with a story for a first, new movie. Make it bold and try to add something new to it.

                    A: Title: Star Wars: Echoes of the Force

                    Setting: 120 ABY (After the Battle of Yavin)

                    Synopsis: A new threat emerges in the galaxy, sparking a quest for an ancient artifact that could restore balance to the Force. The story follows a new generation of heroes, descendants of the original characters, who must navigate a dangerous and ever-evolving galaxy.

                    Act 1:

                    1. Introduce the new protagonists: a Jedi Knight named Kael and his crew, including a skilled mechanic named Norra and a former Imperial officer-turned-ally, Captain Drakon.
                    2. The protagonists stumble upon a cryptic message from Luke Skywalker's era, hinting at the existence of the artifact.
                    3. The message leads them to an ancient and long-abandoned Jedi temple, where they discover the first clue to the artifact's location.

                    Act 2:

                    1. The heroes learn about the artifact's connection to the long-lost civilization of Echo, an ancient Force-sensitive species.
                    2. The Echo civilization was believed to have harnessed the Force in a way that could bring harmony to the galaxy, but their knowledge was lost when they mysteriously vanished.
                    3. The heroes must decipher the Echoes' ancient secrets to find the artifact, while being pursued by the new antagonists: the Shadow Syndicate, a powerful crime organization seeking the artifact for their own nefarious purposes.

                    Act 3:

                    1. The heroes discover the artifact's location on a remote and dangerous planet, guarded by a powerful entity known as the Keeper.
                    2. The Keeper, a Force-sensitive being, tests the heroes' resolve and their understanding of the Force before granting them access to the artifact.
                    3. The heroes successfully retrieve the artifact and learn its true power: the ability to amplify the Force within individuals, unlocking new abilities and restoring balance to the galaxy.
                    4. The Shadow Syndicate is defeated, and the heroes return the artifact to the Jedi Council for safekeeping.

                    Epilogue:

                    1. The heroes, now celebrated across the galaxy, embark on a new journey to explore the lost knowledge of the Echo civilization and further develop their understanding of the Force.
                    2. The galaxy begins to heal from the wounds of the past, as the descendants of the original heroes find their place in a new era of peace and prosperity.
                    3. The legacy of the Jedi, the Skywalker family, and their allies lives on, inspiring future generations to continue the fight for balance and harmony in the galaxy.

                    The End.
                    If you ask it to give you more details, it will start to work individual acts in great detail... let's not do this for now.

                    But if our basement AI can produce such results, imagine what can be done with much more fine-tuned models...

                    Comment


                    • #11
                      As nice as that outline is, it's still based, as almost all Marvel movies are (and the current Mission Impossible is), on "finding an artifact." This leads to endless side roads and expository stuff about the damn artifact, not only figuring out where it is, but finding all the pieces, figuring out what it does, how it works, blah blah blah. Why can't we just have a bad guy with a bad plot and he and his band of outlaws have to be vanquished, banished and/or destroyed, and be done with it?

                      I get a kick out of how every Star Wars story has the core objective of "fighting for balance and harmony." Uh yeah, isn't that basically an oxymoron?

                      I would tell my AI to "make the story sequel-proof" too. Of course then no studio would make the movie.

                      Comment


                      • #12
                        The thing is, generating a new story with AI is cheap and quickly done. As an example:

                        Originally posted by AI Chat Interaction
                        Q: That's a nice start, but I don't want it to be another "MacGuffin hunt", so let's make the story about some major bad guy, rather than some random artifact.

                        A: Title: Star Wars: Shadows of the Sith

                        Setting: 120 ABY (After the Battle of Yavin)

                        Synopsis: A new generation of heroes must face a resurgence of the Sith, led by a powerful and mysterious Sith Lord seeking vengeance for the fall of the old Empire. The story explores the struggle between the light and dark sides of the Force and the consequences of the past on the future.

                        Act 1:

                        1. Introduce the new protagonists: Jedi Knight Kael, skilled mechanic Norra, and former Imperial officer-turned-ally, Captain Drakon.
                        2. The heroes uncover evidence of a growing threat: a powerful Sith Lord, Darth Arcturus, has returned from exile and is amassing an army to avenge the fall of the Empire.
                        3. The heroes seek guidance from the last surviving member of the Jedi Council, Master Elira, who confirms the resurgence of the Sith and the need to stop Darth Arcturus.

                        Act 2:

                        1. The heroes learn about the history of Darth Arcturus, a former Sith apprentice who was thought to have perished during the Battle of Endor.
                        2. Arcturus was betrayed by his master and cast into a distant and uncharted region of the galaxy, where he spent decades plotting his return and rebuilding the Sith Order.
                        3. The heroes discover that Arcturus is using an ancient Sith artifact, the Heart of Darkness, to amplify his power and corrupt the Force.

                        Act 3:

                        1. The heroes travel to the heart of Arcturus's stronghold, a fortress built around the source of the Heart of Darkness's power.
                        2. The fortress is protected by a series of deadly trials designed to test the heroes' resolve and force them to confront their deepest fears and insecurities.
                        3. The heroes overcome the trials and face Darth Arcturus in an epic confrontation, during which they learn the true nature of the Heart of Darkness and its connection to the ancient Sith.
                        4. The heroes defeat Darth Arcturus, destroy the Heart of Darkness, and bring an end to his Sith army, restoring balance to the galaxy.

                        Epilogue:

                        1. The heroes, now celebrated across the galaxy, return to their lives, forever changed by their experiences.
                        2. The legacy of the Sith Lord Darth Arcturus serves as a cautionary tale, reminding the galaxy of the ever-present threat of the dark side.
                        3. The descendants of the original heroes, including the Skywalker family, continue to guide and protect the galaxy, ensuring that the lessons of the past are not forgotten and that future generations remain vigilant against the darkness.

                        The End.​
                        There is still an artifact in there, but it's not part of the central hunt anymore. If you want it gone completely, or replaced by a drunken baboon, no problem, the AI will give a go at it:

                        Originally posted by AI Chat Interaction
                        Q:
                        A: I'm a big fan of I am Weasel. Can we replace the Heart of Darkness with a Drunken Baboon?
                        ...
                        3. The heroes discover that Arcturus is using an ancient artifact, the Drunken Baboon, to amplify his power and corrupt the Force.

                        Act 3:

                        1. The heroes travel to the heart of Arcturus's stronghold, a fortress built around the source of the Drunken Baboon's power.
                        2. The fortress is protected by a series of deadly trials designed to test the heroes' resolve and force them to confront their deepest fears and insecurities.
                        3. The heroes overcome the trials and face Darth Arcturus in an epic confrontation, during which they learn the true nature of the Drunken Baboon and its connection to the ancient Sith.
                        4. The heroes defeat Darth Arcturus, destroy the Drunrunken Baboon, and bring an end to his Sith army, restoring balance to the galaxy.
                        ...
                        As you can see, the LLM interprets "The Drunken Baboon" just as another artifact, but if I told it should be a real comic character pulling some crazy stuff, it would probably just do so.

                        Obviously, this is all shits-and-giggles, but I hope you can see the root of the "problem" here. AI can be used iteratively and very fast. You can easily try some stuff, swap out entire sub-plots and have the AI come up with "new ideas" way faster than a human being would be able to do so, literally in seconds. It won't entirely replace good story writing, for now, but it will speed up a lot of the menial stuff. Coming up with some names for some unimportant side characters? Just ask the AI to provide a list.

                        I myself have used it for "inspiration". I have used it for test-data for example, or if I just needed some stupid "code names" for a project. Also, iterating through some ideas may sometimes be useful. Writing some boilerplate code for you. I've even used it to write cancellation letters and e-mails.

                        For now, AI is just another tool. It isn't replacing humans entirely. Maybe it's making some jobs redundant, but that's somewhat inherent with progress...

                        Comment


                        • #13
                          We run our own AI model in our basement, based on some of the open models out there. It requires quite some beefy hardware, but nothing near what ChatGPT uses.
                          This interests me. Could you go into more detail about what your AI setup consists of in terms of hardware and software?

                          (I really don't know anything about AI other than the few bits and pieces that show up in news articles here and there.)

                          Comment


                          • #14
                            Originally posted by Frank Cox View Post

                            This interests me. Could you go into more detail about what your AI setup consists of in terms of hardware and software?

                            (I really don't know anything about AI other than the few bits and pieces that show up in news articles here and there.)
                            The setup consists of three machines, with an NVidia RTX4090, a Ryzen 7950x CPU, 128 GByte RAM and a few TB of SSD storage. They're running Debian Linux. Those are essentially beefy gaming rigs, but we've put them in server chassis, so they fit in a 19" rack. We generally use two machines for "production" and one machine for "training". Then we have some "cloud capacity" which is paid by the hour to do some heavy lifting for some specific training work.

                            Training your own Large Language Model from scratch is expensive. The costs largely depend on the amount of "parameters" in the model, and those can easily be a few million dollars in computation costs for the more complex models, although those costs are steadily declining with the advent of newer and faster GPUs. Still, it's not attainable for most. But, there are quite a few models out there, some are open-source, others are for research purposes only. Those pre-trained models can be "finetuned" to do more of what you want them to do, at far lesser costs and risks than rolling your own model from scratch. We're currently running a heavily finetuned version of the MPT-30B model, which is an Open Source model. We've trained it with instructions useful for our particular use cases.

                            It's all highly experimental and more like a personal "science" project to get a deeper understanding about the inner workings and the (commercial) potential behind the technology. It's currently completely over-hyped, but I think it would be bad to ignore it, as the implications it could have on society are pretty profound. We all remember the DOT-COM bubble, but the Internet was there to stay and became more than just a small revolution, after the initial hype had blown over.

                            Comment


                            • #15
                              Thanks, Marcel!

                              Comment

                              Working...
                              X