Hey everyone,
I’m working on a small project that pulls data from an online quiz page and displays it on a microcontroller dashboard, but I keep running into problems with how the data is delivered. I was testing this with something like the telenor quiz, and what I’m seeing is that the page loads fine in a browser, but when I try to fetch or scrape data from it using an ESP32 or even a simple api call, the responses are either blocked, incomplete, or change structure randomly.
At first I thought it was just my code, but after testing it in different environments, it seems more related to how the site sends its content, maybe through dynamic scripts, caching, or bot protection. That makes it really hard to build anything reliable on top of it.
Has anyone here dealt with reading or integrating data from sites like this into hardware or IoT projects? I’d love to know if there’s a better approach than just hitting the page directly.
Thanks in advance!