AniSora: Open-source anime video generation model

165 PaulineGar 48 5/17/2025, 11:59:03 PM komiko.app ↗

Comments (48)

kachapopopow · 1h ago
Some of these are very obviously trained on webtoons and manga, probably pixiv as well. This is very clear due to seeing CG buildings and other misc artifacts. So this is obviously trained on copyrighted material.

Art is something that cannot be generated like synthetic text so it will have to be nearly forever powered by human artists or else you will continue to end up with artifacting. So it makes me wonder if artists will just be downgraded to an "AI" training position, but it could be for the best as people can draw what they like instead and have that input feed into a model for training which doesn't sound too bad.

While being very pro AI in terms of any kind of trademaking and copyright, it still make me wonder what will happen to all the people who provided us with entertainment and if the quality continue to increase or if we're going to start losing challenging styles because "it's too hard for ai" and everything will start 'felling' the same.

It doesn't feel the same as people being replaced with computer and machines, this feels like the end of a road.

sshine · 54m ago
It’s great that you have sympathy for illustrators, but I don’t see a big difference if the training data is a novel, a picture, a song, a piece of code, or even a piece of legal text.

As my mom retired from being a translator, she went from typewriter to machine-assisted translation with centralised corpus-databases. All the while the available work became less and less, and the wages became lower and lower.

In the end, the work we do that is heavily robotic will be done by less expensive robots.

earthnail · 31m ago
Here’s the argument:

The output of her translations had no copyright. Language developed independently of translators.

The output of artists has copyright. Artists shape the space in which they’re generating output.

The fear now is that if we no longer have a market where people generate novel arts, that space will stagnate.

wodenokoto · 8m ago
I think the “paper rock cross blade” short films by Corridor is absolute great and can by all accounts be called art and if they make a 3rd they will probably use this model.

In terms of losing styles, that is already been happening for ages. Disney moved to xeroxing instead of inking, changed the style because inking was “too hard”. In the late 90s/early 2000s we saw a burst of cartoons with a flash animation style on TV because it was a lot easier and cheaper to animate in flash.

earthnail · 39m ago
I find it interesting that you echo the concerns of people who defend artists’ copyright claims, while stating that you are very pro AI in terms of copyright.

It’s a very emotionally loaded space for many, meaning most comments I read lean to the extremes of either argument, so seeing a comment like yours that combines both makes me curious.

Would be interesting to hear a bit more about how you see the role of copyright in the AI space.

gabriel666smith · 19m ago
Not GP, though I agree with their views, and make my money from copyrighted work (writing novels).

The role of the artist has always been to provide excellent training data for future minds to educate themselves with.

This is why public libraries, free galleries, etc are so important.

Historically, art has been ‘best’ when the process of its creation has been heavily funded by a wealthy body (the church or state, for example).

‘Copyright’, as a legal idea, hasn’t existed for very long, relative to ‘subsidizing the creation of excellent training data’.

If ‘excellent training data for educating minds’ genuinely becomes a bottleneck for AI (though I’d argue it’s always a bottleneck for humanity!), funding its creation seems a no-brainer for an AI company, though they may balk at the messiness of that process.

I would strongly prefer that my taxes paid for this subsidization, so that the training data could be freely accessed by human minds or other types of mind.

Copyright isn’t anything more than a paywall, in my opinion. Art isn’t for revenue generation - it’s for catalyzing revenue generation.

wordpad · 39m ago
Artists push the envelope.

With AI tools artists will be able to push further, doing things that AI can't do yet.

internet2000 · 6h ago
We’re so close to finally being able to generate our own Haruhi season 3… what a time to be alive.
dvh · 1h ago
Or fix NGE
veonik · 3h ago
Dude… are you telling me it isnt actually finished? I am watching season 1 for the first time…
darylteo · 1h ago
No it's not. 4 of 10 volumes.

The IP is likely doa anyway as it's on indefinite hiatus

stonecharioteer · 1h ago
Shit i haven't heard of this anime in over 10 years. That was a shot of nostalgia
vunderba · 3h ago
From the paper:

> a variable-length training approach is adopted, with training durations ranging from 2 to 8 seconds. This strategy enables our model to generate 720p video clips with flexible lengths between 2 and 8 seconds.

I'd like to see it benched against FramePack which in my experience also handles 2d animation pretty well and doesn't suffer from the usual duration limitations of other models.

https://lllyasviel.github.io/frame_pack_gitpage

isaacimagine · 7h ago
I tested this out with a promotional illustration from Neon Genesis Evangelion. The model works quite well, but there are some temporal artifacts w.r.t. the animation of the hair as the head turns:

https://goto.isaac.sh/neon-anisora

Prompt: The giant head turns to face the two people sitting.

Oh, there is a docs page with more examples:

https://pwz4yo5eenw.feishu.cn/docx/XN9YdiOwCoqJuexLdCpcakSln...

Centigonal · 2h ago
link's broke
polskibus · 1h ago
What would be the copyright status for clips generated with such service? Would the copyright protect it?

Current stance:

https://www.copyright.gov/newsnet/2025/1060.html

“It concludes that the outputs of generative AI can be protected by copyright only where a human author has determined sufficient expressive elements”.

If it isn’t covered (after all it’s the AI that drew all the pictures) then anyone using such service to produce a movie would be screwed - anyone could copy it or its characters).

I’m leaving out the problem of whether the service was trained on copyright material or not.

smusamashah · 5h ago
There are so many glitches even on the very first example. Arm of the shirt glitching, moving hair disappear and appear out of no where. Rest is just moving arm and clouds.
colesantiago · 1h ago
I welcome this.

I know there is a huge market for those excited for infinite anime music videos and all things anime.

This is great for an abundance of content and everyone will become anime artists now.

Japan is truly is embracing AI and there will be new jobs for everyone thanks to the boom AI is creating as well as Jevons paradox which will create huge demand.

Even better if this open source.

userbinator · 30m ago
This is great for an abundance of content and everyone will become anime artists now.

I don't think they'd be artists, but AI-prompters, although you're right that there will be a huge flood of content.

babuloseo · 5h ago
So we can finally remake Akame Ga kill?
throwaway314155 · 7h ago
Says it's open source but I'm having trouble finding a link to weights and/or code?

Looks incredibly impressive btw. Not sure it's wise to call it `AniSora` but I don't really know.

dh1011 · 7h ago
throwaway314155 · 7h ago
Thanks!

> This model has 1 file scanned as unsafe. testvl-pre76-top187-rec69.pth

Hm, perhaps I'll wait for this to get cleared up?

lbeltrame · 1h ago
Disty of SD.Next has made a version in diffusers format.

https://huggingface.co/Disty0/Index-anisora-5B-diffusers

For the record, the dev branch of SD.Next (https://github.com/vladmandic/sdnext) already supports it.

userbinator · 5h ago
I wonder if the entropy of model weights and their size causes statistical false positives to appear often?
throwaway314155 · 4h ago
I imagine it has more to do with whether or not the file appears to have executable python code in it, as a .pth file is usually just a a pickled python object and these can be manipulated to load arbitrary python code when loaded.
echelon · 6h ago
This is not the first time I've heard of checkpoints being used to distribute malware. In fact, I've heard this was a popular vector from shady international groups.

I wouldn't expect this from Bilibili's Index Team, though, given how high profile they are. It's probably(?) a false positive. Though I wouldn't use it personally, just to be safe.

The safetensors format should be used by everyone. Raw pth files and pickle files should be shunned and abandoned by the industry. It's a bad format.

echelon · 6h ago
> Not sure it's wise to call it `AniSora` but I don't really know.

Given that OpenAI call themselves "Open", I think it's great and hilarious that we're reusing their names.

There was OpenSora from around this time last year:

https://github.com/hpcaitech/Open-Sora

And there are a lot of other products calling themselves "Sora" as well.

It's also interesting to note that OpenAI recently redirected sora.com, which used to be its own domain, to sora.chatgpt.com.

pests · 2h ago
> OpenAI recently redirected sora.com, which used to be its own domain, to sora.chatgpt.com.

Probably to share cookies.

echelon · 2h ago
Cookies are such a mess.

We need cross-domain cookies. Google took them away so they could further entrench their analytics and ads platform. Abuse of monopoly power.

washadjeffmad · 6h ago
>Powered by the enhanced Wan2.1-14B foundation model for superior stability.

Wan2.1 is great. Does this mean anisora is also 16fps?

MattRix · 2h ago
I might be missing something, but it feels weird that it’s named after Sora?
chii · 2h ago
sora is the japanese word for sky, and it's not that uncommon a name.
s0rr0wskill · 5h ago
can i generate hentai
topato · 4h ago
Inquisitive minds need to know!

But seriously, I had the same thought, considering the general lack of guardrails surrounding high-profile Chinese genAI models... Eventually, someone will know the answer... It's inevitable...

hatsunearu · 4h ago
So was this trained on existing anime? Ain't no way the corpus was licensed legally.
mythz · 3h ago
China doesn't know what you're talking about.
Lerc · 4h ago
The right to train models on copyrighted data has yet to be determined.
mattigames · 3h ago
Not like chatgtp and sora which as all we all known are fully trained in public licensed content free of copyright.
mitthrowaway2 · 2h ago
Exactly, that's why they aren't able to replicate the Studio Ghibli style.
tonyhart7 · 4h ago
"animated video generation model presented by Bilibili."

You understand that china has "different" view on copyright,license etc right??

yorwba · 2h ago
Not that different. Bilibili is a big, above-board video streaming service; they definitely have distribution rights to a large collection of anime content. (They also have YouTube-style user uploads where proper licensing is less likely.)

It's the equivalent of Crunchyroll putting out a video generation model. If the rightsholders disagree with this usage, it'll come up during the negotiations for new releases.

tonyhart7 · 15m ago
"It's the equivalent of Crunchyroll putting out a video generation model. If the rightsholders disagree with this usage"

how can you prove then??? its literally the same way OpenAI use Ghibli material and they can't do anything about it

dbacar · 2h ago
Do you think all that all the big guys just asked people while training their models?
SiempreViernes · 2h ago
Really? We've all seen the stories on how Meta sourced book content from Anna's Archive and still you try to claim things are different in China?
tonyhart7 · 18m ago
so we playing whataboutism now?? huh

then tell me what chinnese government stance on this matters, because I can tell that Meta doing is illegal but I cant say the same with chinnese company doing it on mainland china

ekianjo · 3h ago
There are very few models out there that are not trained on data protected by copyright. So nothing new for the past 3 years
ronsor · 4h ago
China doesn't care about silly licenses.