Tech News Auto-Publish System

I am seeking an expert to create a system adept at scraping, rewording, and publishing daily updates on technology news on my website. This system must also efficiently integrate relevant images with every piece of news it processes. Here are the key project details and requirements: - **Topics and Keywords Focus:** The system should exclusively track and gather updates on technology news. It must smartly identify and prioritize hot topics and emerging trends within the tech industry. Specific keywords will be provided when the solution is ready to be tested. Keywords must be configurable & allow for the commission or addition of new keywords. - **Content Publication:** The targeted platform for publishing these updates is a website. The system must seamlessly integrate with the site to ensure updates are live as quickly as possible, maintaining a fresh stream of content. - **Image Integration:** Alongside text updates, the inclusion of pertinent and visually appealing images is crucial. These images should either be sourced from the original news content or from repositories that offer free-to-use images to ensure compliance with copyright laws. **Ideal Skills and Experience:** - Proficiency in Python, Beautiful Soup, and Requests for web scraping and content aggregation - Experience in content rewriting or natural language generation to ensure content uniqueness - Strong understanding of image processing and sourcing legally usable images - Web development skills to automate content publishing on websites - Familiarity with task scheduling and background job processing. - Knowledge of web scraping ethics and copyright laws. Responsibilities: Web Scraping: Implement scripts using Python (Beautiful Soup, Requests) to scrape articles/news from predefined sources based on provided topics and keywords. Ensure compliance with web scraping ethics and legality. Content Rewriting: Use NLP techniques or APIs (e.g., OpenAI's GPT, spaCy) - (ChatGPT 4 subscription available) to rewrite scraped content uniquely, maintaining the original meaning while avoiding plagiarism. The rewritten content should be engaging and grammatically correct. Automation: Set up a daily task using Celery with Redis or RabbitMQ to automate scraping and rewriting processes. Quality Assurance: Develop a system to ensure the uniqueness and quality of the rewritten content. The ideal candidate will have a proven track record of developing similar content automation systems and a deep understanding of both the technical and ethical considerations involved in content scraping and republishing.