Rendered at 14:29:24 GMT+0000 (Coordinated Universal Time) with Cloudflare Workers.
faangguyindia 13 hours ago [-]
How would I create a video like this?
For example, I have several posts that explain concepts in detail, with supporting images. They're written in Markdown, and I keep refining them until I'm confident that the average person can read them and immediately understand the concept.
The problem is that text is becoming a less popular medium for learning, while short form videos are increasingly being used to explain the same ideas.
From what I can tell, this tool only lets you provide a prompt. Can it turn my existing Markdown posts and images into videos, or is it mainly intended for generating videos from simple prompts? I'm looking for something that preserves the explanations I've already written rather than creating something entirely new.
faangguyindia 13 hours ago [-]
it works, but can u add different style of videos like this one:
These are the two styles that consistently keep me watching. I can't really describe them well in words, so I linked the videos directly to avoid losing important details in the translation from visual format to text.
Maybe someone with more experience in video production can explain what techniques are being used here and why they're so effective at holding viewers' attention.
gpt5 7 hours ago [-]
They cut to the next scene a moment before the next sentence, and they cut to the next sentence before the last word finished (i.e. no periods between sentences).
pw 13 hours ago [-]
So this is really just a kinda proof of concept, but I'd be pretty easy to turn it into what you want. It sounds like you've already got both basically a script and images to go with it?
faangguyindia 13 hours ago [-]
Your project reminds me of something I built a while ago using Pollination.ai for images, Gemini Flash for script / captions / inserting transitions and all other editing, Google Cloud TTS for narration/voice, and FFmpeg drive by flash, back then Gemini Flash 2.5 (free) is what i used for these experiments. The result looked like this:
I wasn't happy with how it turned out, so after making 3–4 videos I dropped the idea.
Later, I came across several different video styles that consistently kept me watching. That's when I realized what my videos were missing they simply didn't have the same ability to capture and hold attention.
But i never managed to generate those styles after dozens of attempts and gave up.
nickvec 14 hours ago [-]
Fun idea! Hope it doesn't cost you too much to keep up depending on how much traction this thread gets ;)
One small quirk I noticed with the generated short video: for each new slide/photo, there is a very gradual "zoom in" effect that occurs, which causes text to jitter a bit and is a bit disorienting. Not sure if that is specific to the "The Great Molasses Flood of 1919 in Boston" prompt I used or not.
Also, is Claude involved in the video generation itself? I noticed the generated video has "By Claude" in the top left corner, but the logs seem to indicate that only GLM-5.2, Gemini Flash, and GPT-4o are involved (just curious!)
pw 13 hours ago [-]
Yeah, that's suppose to be a Ken Burns style zoom but I haven't figured out how to stop the shake the should probably just remove it. And I need to remove the "By Claude" too. That's a remnant from porting from my internal framework for the [By Claude)(https://www.youtube.com/@byclaude) Youtube, TikTok, etc channels.
f055 6 hours ago [-]
You could probably make your infra cheaper if you sent the generated slides to the web client and use some js ffmpeg wasm to compile the video in the browser. This way you could probably use the cheapest VPS to handle this.
eckelhesten 6 hours ago [-]
It’s an interesting concept, perhaps it could go more from ”narrated slide show” to ”video clip” in the near future if it doesn’t cost too much.
pw 6 hours ago [-]
Yeah I'd been thinking of Gemini Omni for that but it adds about 10 cents per second of video, so not cheap.
bitelchux 2 hours ago [-]
Could you publish the source code or how to do it for our sueltes?
albert_e 11 hours ago [-]
Currently getting errors
---
File "/usr/lib/python3.10/concurrent/futures/thread.py", line 58, in run
result = self.fn(self.args, *self.kwargs)
File "/home/ubuntu/byclaude/video/harness/pipeline/pipeline.py", line 829, in build_clip
clip = round(dur + TAIL, 3)
TypeError: unsupported operand type(s) for +: 'NoneType' and 'float'
Video build failed (pipeline exit 1) — please try again.
Powered by AI · by Claude · ~
pw 10 hours ago [-]
Should be fixed now
ramon156 7 hours ago [-]
Cool idea! Looks like my prompt is stuck, though. Might be an idea to provide a share link at the moment of hitting the button so you can check back later, because if I close the tab I will lose my prompt
pw 6 hours ago [-]
Yeah the disk on the instance filled up and it was down. Sorry. It's up again now.
pw 14 hours ago [-]
I'm around to answer questions or receive feedback if anyone as any!
urbnspacecowboy 7 hours ago [-]
Please, pretty please, link some pre-generated examples.
pw 6 hours ago [-]
On it!
djdndnjdf 14 hours ago [-]
[dead]
pw 13 hours ago [-]
Ugh looks like I'm hitting my Gemini Tier 1 usage limits. Sorry!
pw 12 hours ago [-]
Fixed!
ms7892 13 hours ago [-]
Image not generating?
pw 12 hours ago [-]
Fixed!
pw 12 hours ago [-]
Working on it!
mellosouls 7 hours ago [-]
I'm guessing its being hugged now - it says generate in under a minute but my short is taking ten minutes and counting; anyway I like the simplicity and am interested in seeing the results - though I do think it is quite depressing as we will see this sort of service mostly put to use for slop.
pw 6 hours ago [-]
Hi! Sorry yeah, I'm been bumping up against rate limits, but it should be working again now!
mellosouls 5 hours ago [-]
Ah great yes just tried it, nice and simple!
I think that simplicity is its main selling point at the moment as its otherwise a pretty crowded marketplace.
Best of luck with it, however you decide to progress it.
pw 5 hours ago [-]
Thank you! Simplicity and speed were exactly what I was going for.
For example, I have several posts that explain concepts in detail, with supporting images. They're written in Markdown, and I keep refining them until I'm confident that the average person can read them and immediately understand the concept.
The problem is that text is becoming a less popular medium for learning, while short form videos are increasingly being used to explain the same ideas.
From what I can tell, this tool only lets you provide a prompt. Can it turn my existing Markdown posts and images into videos, or is it mainly intended for generating videos from simple prompts? I'm looking for something that preserves the explanations I've already written rather than creating something entirely new.
Style 1: https://www.youtube.com/shorts/vGjrv2zjfsM
Style 2: https://www.youtube.com/shorts/6KoRHpAZ4zk
These are the two styles that consistently keep me watching. I can't really describe them well in words, so I linked the videos directly to avoid losing important details in the translation from visual format to text.
Maybe someone with more experience in video production can explain what techniques are being used here and why they're so effective at holding viewers' attention.
https://www.youtube.com/shorts/IhGR8AC3a_g
Uploaded on sep 24, 2024.
I wasn't happy with how it turned out, so after making 3–4 videos I dropped the idea.
Later, I came across several different video styles that consistently kept me watching. That's when I realized what my videos were missing they simply didn't have the same ability to capture and hold attention.
But i never managed to generate those styles after dozens of attempts and gave up.
One small quirk I noticed with the generated short video: for each new slide/photo, there is a very gradual "zoom in" effect that occurs, which causes text to jitter a bit and is a bit disorienting. Not sure if that is specific to the "The Great Molasses Flood of 1919 in Boston" prompt I used or not.
Also, is Claude involved in the video generation itself? I noticed the generated video has "By Claude" in the top left corner, but the logs seem to indicate that only GLM-5.2, Gemini Flash, and GPT-4o are involved (just curious!)
---
File "/usr/lib/python3.10/concurrent/futures/thread.py", line 58, in run result = self.fn(self.args, *self.kwargs) File "/home/ubuntu/byclaude/video/harness/pipeline/pipeline.py", line 829, in build_clip clip = round(dur + TAIL, 3) TypeError: unsupported operand type(s) for +: 'NoneType' and 'float' Video build failed (pipeline exit 1) — please try again. Powered by AI · by Claude · ~
I think that simplicity is its main selling point at the moment as its otherwise a pretty crowded marketplace.
Best of luck with it, however you decide to progress it.
Quotations from Chairman Mao Tse-tung (Short form)
The audio narration is great and the documentary is accurate. Improvements could include more pictures or animations.
This is a very great tool and framework! Thank you so much.