Closed

Big data Project - using sentence embedding(word2vec, doc2vec) and gradient boost models such as catBoost

1. Collect and process pdf data dump from COVID-19 Open Research Dataset Challenge (CORD-19)

[login to view URL]

2. Analyze the data and provide publication statistics such as the number of publications according to time, location but not limited to. Provide (any type of) visualization for the results.

3. Learn sentence embedding from the articles' abstract and main content respectively.

4. Build a tool for question answering: given a user input sentence or query, outputs the top 10 most relevant sentences from the data and the source of the data, i.e., the sentence comes from which article. The tool could be command-line based or a simple Web-based interface.

Note that the dataset is large, so if you have difficulties processing all the articles provided in the dataset, you could work on part of it but no less than 5000 articles. And provide justification of why you choose the number of articles to work o

Skills: Python, Big Data, Data Science, Neural Networks, Web Scraping

See more: export excel data project using macro, skype big data project, BIG data project, big data project freelancer, freelancer big data project, big data project bidding, big data project ideas for students, big data project examples, big data processing using hadoop, big data project management, example big data project plan, big data project manager job description, big data project manager roles and responsibilities, big data project manager resume, big data project challenges, big data project steps, big data project process, big data project titles, big data project report pdf, https www kaggle com uciml student alcohol consumption data

About the Employer:
( 1 review ) sydney, Australia

Project ID: #31906837

7 freelancers are bidding on average $169 for this job

(41 Reviews)
6.8
(68 Reviews)
7.0
nibeditad007

Hi, Hope you are doing well. I have over 6 years of rich experience in data science and machine learning. I have worked hands on in Python with different datasets for data wrangling, data manipulation, data analysis More

$250 AUD in 5 days
(14 Reviews)
4.7
duongquocdat7411

Hello, I am a data scientist with strong background in machine learning and statistics and more than 3 years in building complex ML systems in NLP, computer vision, active learning, federared learning, few-shot learnin More

$200 AUD in 7 days
(11 Reviews)
4.3
freelancerIrvan

Hello, There I am a talented python web scraper and automation specialist. I am familiar with data extracting using requests, scrapy, selenium and bs4, so I have rich experience in scraping of many plat More

$139 AUD in 7 days
(3 Reviews)
3.9
edwardfree

Dear Client Thank you for your project. I've just checked your job description carefully. I'm senior developer with 9+ years of Python. By using Python, I developed AI engine, BOT, Web Scraping Tools, Web Searching Too More

$140 AUD in 7 days
(1 Review)
1.9
andreizabauski

Hi dear, I have read your job description carefully and I am very interested in your pdf scraping project. I will use Beautifulsoup to perform your large data scraping. Beautifulsoup is very good python scraping libra More

$140 AUD in 7 days
(0 Reviews)
0.0