alt Hacker NewsI probably will be burned for this, but with the help of an LLM I wrote a tiny program that captures video from a browser screen (Xbox live online FPS game), passes the video images through a small trained NN that recognizes people forms and presents the video on another screen. That way I can place a green overlay on enemies and they are easier to see on PVP matches.
All that in around 100 lines of code, including the training/fine-tuning of the tiny YOLO nn.
Replies
Why would you get burned for this? For people who don't know, sure, this smells of 'cheating' but it's essentially just an exercise in computer vision. Also, I'd posit that using various DMA type tools in the video game modding arena are impressive and unusually secretive because they make money on subscription services. It's fascinating to me how well some of those tools and mux hardware works. When you combine that with hardware we can now buy like the DGA with more onboard memory and faster interconnects, it's going to make reverse engineering, malware analysis, forensics -- a very interesting time for those who know what they are doing.
Would you either share the code, or describe the approach? I’ve asked LLMs how to do something similar a few times recently, and received several different potential approaches. I’m still no clearer which route to take!
I'm curious, what amount of input lag does this introduce?