Configure crawlers using regular expressions

Budget $2 - $8 USD / hour
Bids 9
Average Bid $9
Status Closed

We have a crawling technology that we are using to find all relevant content on specific sites. We need someone who can help us configure those crawlers using regular expressions so that:

1) The crawlers find ALL RELEVANT content. That meaning following all relevant links but not the irrelevant links

2) Extract all relevant metadata in a specific HTML/URL. We have a system for this too but need the regular expressions from you.

We will do this in several countries all around the world so if you perform well here it will be a lot of work to do in the months and years to come.

Applicants to this job will be invited to take a small test before they get selected.

The test has 10 Regular Expression questions and 1 open question, and it takes approximately between 30 minutes and 1 hour. Expressions will be tested with .NET Regex engine, Case Insensitive and Single Line.

We will provide a tool for testing the Regular Expressions during the test.

We are using [url removed, login to view], so this should be taken slightly into consideration. Take a look at the attached file.

Get Free Quotes For A Project Like This

Looking to make some money?

  • Set your budget and the time frame
  • Outline your proposal
  • Get paid for your work

Bids on this Project

  • qualifiedcoders Profile Picture


    NEW DELHI,  India

    Our team of highly qualified professionals helps to deliver end to end solutions from project initiation, planning, design, development, QA, deployment, support and maintenance. Throughout the project execution we also provide documentation services (SRS, Wireframes) for all artifacts related to each phase of SDLC.Apart from this we also provide high quality website design services and web promotion services for any type of business. Range of Services ►Web, Mobile and Desktop Custom/Bespoke Application Development ►IT And Business Consulting ►UI/UX & Designing ►Quality Assurance and Testing ►Marketing & Branding ►IT Infrastructure Services ►Writing & Translation Services ►Data Entry Services Our Technology Stack: .Net,ASP.NET,C#,PHP, MSSQL, Mysql, Azure, Android, iPhone,HTML5, CSS3, Sitefinity, Kentico, Umbraco, KnockoutJS, NodeJS, AngularJS, EmberJS, Javascript, Kendo UI, jquery, Dotnetnuke, MEAN, Lightswitch, Silverlight,WPF, WCF, Web Services,MVC, Wordpress, Bootstrap,Java

  • srinichal Profile Picture


    Hyderabad,  India

    Perfection and dedication are the way we deal with projects on freelancer. There have been many clients all over the world that are satisfied with the solutions provided.All types of automation works along with web based solutions are our expertise. Looking to provide solutions in the Mobile markets as well. Some of the automation tools are listed in portfolio and here as well: * AutoBidder tool for Madbid like sites * Automation tools For all emails and social Bookmark sites * Social Bookmarking tools * Facebook Likes Automation * Webbased Versions of tools tailored to custom needs * Desktop apps tailored to customer needs * Proxy tools tailored to your requirements. A dedicated team that can literally deliver any project solution with high expertise. Please don't hesitate to contact us via freelancer. Satisfaction guaranteed solutions delivered all over the world. The Skill Set ranges from C# to PHP, Iphone to Andriod. We can deliver almost any solutions for your needs. We can also take up any type of work based on web design to desktop or mobile in the broad spectrum as we always strive to learn and perfect.

  • ultrasonicsoft Profile Picture


    Mumbai,  India

    About Me: Masters in Computer Science (Gold Medalist - University Topper) 10+ years of Software and Website Development Experience Worked with Siemens, Credit Suisse, Morgan Stanley, Citi Bank and other CMMi 5 companies Technical Skill set: ============== C#, WPF, WinForm, WCF, SQL Server Angularjs, Javascript, Typescript, Twitter Bootstrap, Google Material Design,Nodejs Projects: ============== * Public Folder Exporter * Lawyer Application * Glass cutting project * Set Default Home Page of all browsers in windows OS * Download Manager to download files from client server * Microsoft MapPoint Maps for Truck Transport Tracker software * C#.NET Dummy COM Server Wrapper to be used in VB 6.0 * Complex SQL Stored Procedure writing * Website scrapper for vehicle transport system * Encryption & Decryption Dll with custom private key * Windows Context Menu Editor - Edit "SendTo" menu * Online C program compiler * Customer Windows Service Window - Multiple service start and stop at once.

  • jitendraparmar07 Profile Picture


    indore,  India

    we provide highly professional and skilled solution in 1.) Financial software solutions specialized in forex market 1.1) Expert Advisers , Indicators and Scripts ( MQL 4/5 / C# / C++ ) 1.2) Algorithmic Trading Software ( Desktop and Web Apps ) 1.3) Forex Strategy Development ( MQL 4/5 / C# / C++ ) 1.4) APIs Development ( Advanced algorithmic calculations) 1.5) Platform - Meta Trader 4 / 5 , Ninja Trader 2.) Automated web scraping and data mining solutions 2.1) Using Java , C# and PHP . 2.2) HTML Unit , Selenium and all leading technologies 2.3) Manage CMS - Magento,WordPress ,Joomla .

  • aaravsoft Profile Picture


    Surat,  India

    I am software engineer with 14 years of experience in whole software life cycle, analysis, design, implementation and testing. I have wide experience in the software industry, delivering projects on time and within given budget. Software development and customization using wide range of Microsoft technologies (.Net, ASP, C#, VC++ CLI, VB , MVC, WPF, Window form, Sql Databases, Azure, Sync framework, Kendo UI etc...).

  • SigmaVisual Profile Picture


    Taxila Cantt,  Pakistan

    Web, Bots, Crawlers, and Scrapers Development. I have expertise in automation services and I can automate any manual process.

  • bob1982 Profile Picture


    PATIALA,  India

    I am a professional newcomer into the area of .NET. I have great experience in the similar areas of Advertising and Android. I have got excellent proficiency and training as a C# Programming Developer and C++ Programming Developer as I have taken up various projects in these areas. I am ready to start working for you. Hire me and I will put in my best effort to bring laurels to your company.

  • enriquethumar Profile Picture


    Ahmedabad,  India

    Hello Everyone, We are TEAM BRAINBOX , an experienced group of Developers with over 7 years experience My expertise are : php , drupal , wordpress , joomla , smarty magento , oscommerse , woocommerce x-cart, zen cart, opencart zend , cakephp , codeignator , laravel html5 , css3 , javascript , twitter bootstrap , jquery mysql , paypal , stripe , , 2checkout Amazone web services I hope you would like to work with me. Have a nice day. Thanks, Enrique Thumar