Hi,
I need help with a problem I'm currently facing.
I'm running an application (a scraper) on multiple servers, but the output is insufficient.
I'm not nearly getting enough data as required. I've tried to increase the output by trying multiple things.
I've already tried the following:
- using multiple servers (I'm getting more output, but based on my calculations I would need many more servers to achieve my daily goals, so getting more servers than I already have is not an option)
- running multiple instances (As soon as I run more than one server on the same device, the speed goes down significantly)
- Increasing the ram of each server (this had no significant effect)
- Using servers with a faster CPU and more core (this had no significant effect)
I'm looking for someone to first suggest a solution and then implement it if I agree to the proposed solution.