{"id":6265,"date":"2024-12-11T09:38:35","date_gmt":"2024-12-11T09:38:35","guid":{"rendered":"https:\/\/tech.newat9.com\/index.php\/2024\/12\/11\/sora-is-out-kind-of-capabilities-evaluated\/"},"modified":"2024-12-11T09:38:35","modified_gmt":"2024-12-11T09:38:35","slug":"sora-is-out-kind-of-capabilities-evaluated","status":"publish","type":"post","link":"https:\/\/tech.newat9.com\/index.php\/2024\/12\/11\/sora-is-out-kind-of-capabilities-evaluated\/","title":{"rendered":"Sora Is Out \u2013 Kind Of\u2026 Capabilities Evaluated"},"content":{"rendered":"


\n<\/p>\n

\n
<\/p>\n

Demand for Sora catalytic computing power is continuing to soar, further benefiting infrastructure … [+]<\/span> vendors in Suqian, Jiangsu Province, China, on February 19, 2024. (Photo Illustration by Costfoto\/NurPhoto via Getty Images)<\/span><\/p>\n

<\/fbs-accordion>NurPhoto via Getty Images<\/small><\/figcaption><\/figure>\n

The world is getting a sneak peek at a major transformative technology of our time \u2013 one that\u2019s probably going to displace more resources than some of the other multimedia models that we\u2019ve seen in the past.<\/p>\n

With the capability to create full video from prompts, Sora is going to make all kinds of casting, staging and expensive film operations obsolete. And it\u2019s supposed to be available right now! At least to ChatGPT Plus and Pro users.<\/p>\n

A Big Shift<\/strong><\/h2>\n

Think about all of the work involved in manufacturing, using and developing physical film for pictures. Think about what the digital camera did to that industry.<\/p>\n

Sora is going to be so much more transformative, on such a scale, that it\u2019s really worth paying a lot of attention as it gets into the hands of a wider group of users.<\/p>\n

Marques Brownlee<\/a> is a YouTuber who has quite a lot of influence and got a front row seat to early Sora exploration.<\/p>\n

<\/p>\n

In a YouTube critique, Brownlee points out how capable and adapt the program is at generating realistic looking footage, while admitting that it still has a way to go.<\/p>\n

Was it Gandhi or Stalin? <\/strong><\/h2>\n

For those used to play the game where you guess which person said something, Brownlee shows us a series of short videos, and asks us to figure out whether they are real or AI-generated.<\/p>\n

What you see is that it can be pretty hard to tell.<\/p>\n

There aren\u2019t a lot of blatant cues to let us know which videos were made with AI and which weren\u2019t<\/p>\n

Not Many Clues<\/strong><\/h2>\n

There are a few obvious tells when it comes to AI video, but they\u2019re mostly based on our knowledge of the world around us.<\/p>\n

Here are three that popped out to me:<\/p>\n

Not factual \u2013 one way you can tell that video is AI-generated is if it has factually wrong elements in a picture, such as a landscape that you\u2019ve seen before.<\/p>\n

If you know, for example, that there is not a dilapidated shack on the top of some hill, you\u2019ll note the difference when the AI shows you an aerial view.<\/p>\n

Not \u2018ugly\u2019 enough \u2013 it seems that Sora products still adhere to the same tendency as still image and General AI technologies in general \u2013 they tend to produce produce glitzy, beautiful results. In other words, one of the few tells that you have is that the program doesn\u2019t tend to create mediocre-looking film with actual composition or lighting problems, or subjects that aren\u2019t telegenic and prepped for film.<\/p>\n

However, you could presumably generate this kind of thing with more prompting.<\/p>\n

Not credible \u2013 another way to tell AI video is if you see tentacle monsters or other unreal things cropping up in the margins. But again, that has more to do with our knowledge of the world than anything we can assess visually. If you see a tentacle god arise from a lake in a Sora video, it\u2019s going to look real.<\/p>\n

Now, after I wrote these down, I watched the rest of Brownlee\u2019s video, and he lays out some additional lapses in Sora hyper-realism, so check these out:<\/p>\n

First, there is the lack of object permanence, where items or characters can appear and disappear randomly. There\u2019s also a sort of \u2018ghost image\u2019 phenomenon where an object is going to have a lack of substance \u2013 for example, in Brownlee\u2019s video, we see cars passing through another car in what is supposed to be a real-life street video.<\/p>\n

In general, Brownlee points out, Sora struggles with physics. It doesn\u2019t always know how objects behave in motion, or what direction they were going in, if it\u2019s working based off of a still image.<\/p>\n

Then there is are some issues with speed, where a video may slow down and speed up for no reason.<\/p>\n

All of this aside, some of the videos will be so realistic that we have trouble telling them apart from live footage.<\/p>\n

Access to Sora Right Now<\/strong><\/h2>\n

Over at OpenAI\u2019s site, it looks like Sora access has been temporarily paused due to high traffic volumes.<\/p>\n

Brownlee talks about this eventuality in his video:<\/p>\n

\u201cI kind of wonder how long it will take when it\u2019s open for everyone to use,\u201d he says, noting that a 1080 P film of about 10 seconds takes a couple of minutes for him to generate.<\/p>\n

Use Cases for Sora<\/strong><\/h2>\n

As Brownlee points out, Sora may be more useful for a lot of people who want to create cartoon or claymation features.<\/p>\n

That\u2019s because the physics is really hard to get right in real life, but cartoons and stop action footage are more forgiving. They\u2019re more abstract, and that\u2019s going to be one of the first realms that Sora becomes most useful in, although Brownlee also cites fake CCTV camera footage as a desirable way to use the platform.<\/p>\n

He shows off a \u2018Santa versus Frosty\u2019 Mortal Kombat game video completely made up by the AI\u2026and a job interview scene, in which Sora shows some of the details that the model can provide without any additional prompting.<\/p>\n

However, he suggests there are some big unknowns with this technology, and we\u2019re moving through uncharted waters.<\/p>\n

When we all start using Sora, what will we use it for? How will it affect our lives?<\/p>\n

People are wondering about what\u2019s going to happen to those major industries that are often centered around places in Southern California like Burbank and Hollywood.<\/p>\n

But the effect of the technology will likely go far beyond that. Stay tuned as I continue to document what\u2019s coming out now at the end of what\u2019s been a banner year for large language models.<\/p>\n<\/div>\n


\n
Source link <\/a><\/p>\n","protected":false},"excerpt":{"rendered":"

Demand for Sora catalytic computing power is continuing to soar, further benefiting infrastructure … [+] vendors in Suqian, Jiangsu Province, […]<\/p>\n","protected":false},"author":1,"featured_media":6266,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"site-sidebar-layout":"default","site-content-layout":"","ast-site-content-layout":"","site-content-style":"default","site-sidebar-style":"default","ast-global-header-display":"","ast-banner-title-visibility":"","ast-main-header-display":"","ast-hfb-above-header-display":"","ast-hfb-below-header-display":"","ast-hfb-mobile-header-display":"","site-post-title":"","ast-breadcrumbs-content":"","ast-featured-img":"","footer-sml-layout":"","theme-transparent-header-meta":"","adv-header-id-meta":"","stick-header-meta":"","header-above-stick-meta":"","header-main-stick-meta":"","header-below-stick-meta":"","astra-migrate-meta-layouts":"default","ast-page-background-enabled":"default","ast-page-background-meta":{"desktop":{"background-color":"var(--ast-global-color-4)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"tablet":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"mobile":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""}},"ast-content-background-meta":{"desktop":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"tablet":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"mobile":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""}},"footnotes":""},"categories":[1],"tags":[],"_links":{"self":[{"href":"https:\/\/tech.newat9.com\/index.php\/wp-json\/wp\/v2\/posts\/6265"}],"collection":[{"href":"https:\/\/tech.newat9.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/tech.newat9.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/tech.newat9.com\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/tech.newat9.com\/index.php\/wp-json\/wp\/v2\/comments?post=6265"}],"version-history":[{"count":0,"href":"https:\/\/tech.newat9.com\/index.php\/wp-json\/wp\/v2\/posts\/6265\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/tech.newat9.com\/index.php\/wp-json\/wp\/v2\/media\/6266"}],"wp:attachment":[{"href":"https:\/\/tech.newat9.com\/index.php\/wp-json\/wp\/v2\/media?parent=6265"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/tech.newat9.com\/index.php\/wp-json\/wp\/v2\/categories?post=6265"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/tech.newat9.com\/index.php\/wp-json\/wp\/v2\/tags?post=6265"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}