Freelancer logo How It Works Browse Jobs Log In Sign Up Post a Project
EXPLORE
Amazon S3 Amazon Web Services JavaScript JSON Shell Script
You're now following .
Error following user.
This user does not allow users to follow them.
You are already following this user.
Your membership plan only allows 0 follows. Upgrade here.
Successfully unfollowed user.
Error unfollowing user.
You have successfully recommended
Error recommending user.
Email successfully verified.
User Avatar
Our Rate
$52 USD / hour
Flag of INDIA
new delhi, india
Our Rate
$52 USD / hour
It's currently 10:03 AM here
Joined June 24, 2017
2 Recommendations

VisionFirst Technologies

@salesvft

annual-level-two.svgpreferred-freelancer-v2.svgverified.svg
4.8 (18 reviews)
5.8
5.8
$52 USD / hour
Flag of INDIA
new delhi, india
$52 USD / hour
100%
Jobs Completed
97%
On Budget
98%
On Time
14%
Repeat Hire Rate

AWS Select Consulting Partner & Microsoft Partner

featured review
"The project involved a complex AWS use case which Shilpa was able to untangle and deliver on time and on budget. Other freelancers on this site claimed to be able to do the work only to find out afterwards that they could not. Shilpa succeeded where other freelancers did not. If you're looking to hire an expert AWS Architect, I can thoroughly recommend Shilpa."
- Nic R.
We are "AWS Select Consulting Partner" and "Microsoft Partner". [login to view URL]. We boast of Technical prowess, Domain understanding and willingness to go beyond the call of duty to serve our customers. We deploy solutions on-premise and on-cloud. Our tech stack includes Public Cloud, Hybrid Cloud, Serverless Architecture, Serverless Databases, Data pipeline to process 100+ million messages per day, Highly Available, Highly Scalable and Highly Fault Tolerant micro-service Applications, precision UX mobile apps, Web applications, Bank-grade secured applications (Cyber Security), IOT, Machine Learning/Deep Learning and Big Data Technologies. You name the technology and we may already have explored it. Our business domains include Fintech, Edutech, Sports Tech and logistics. We always learn new domains to talk to business in business language.
Freelancer Amazon Web Services Experts India

Contact VisionFirst Technologies about your job

Log in to discuss any details over chat.

Portfolio Items

We are authorized to use AWS Select Consulting Partner logo and have been listed on AWS site. Reference: https://partners.amazonaws.com/partners/0010h00001cA5v9AAC/VisionFirst%20Technologies%20Pvt.%20Ltd.
Listed on AWS website - AWS Select Consulting Partner
We are authorized to use AWS Select Consulting Partner logo and have been listed on AWS site. Reference: https://partners.amazonaws.com/partners/0010h00001cA5v9AAC/VisionFirst%20Technologies%20Pvt.%20Ltd.
Listed on AWS website - AWS Select Consulting Partner
We are officially Microsoft Partner. The attached logo is testament to this fact.
Microsoft Partner
Send webcam feed to Kinesis Video Stream
Raspberry Pi take pictures when PIR senses intrusion
Raspberry Pi temperature, humidity TO AWS IOT Core
Requirement
The customer needed to scrape from a website using input from a file . There must be a retry mechanism. Operating cost should be low.

Solution
1. Create an event on S3 bucket when a new input file is uploaded
2. Trigger an AWS Batch that will 
   a) read input file and create steps based on input file
   b) scrape from target website, retry if required
   c) aggregate collected data and send report
   d) cleanup transient info
3. AWS ECR contained Docker images
4. All notifications are via SNS (user subscribed for SMS and email alert)
5. Batch failure triggers SNS notification
6. Spot instances (can be upto 80% discounted) for AWS Batch

Solution Components:
1. Docker
2. Elastic Container Repository (ECR)
3. AWS Batch. This inturn uses Elastic Container Service (ECS) - Fargate
4. S3
5. Simple Notification Service (SNS)
6. Simple Email Service (SES)
7. Cloudwatch

Result
Over 95% of the records are scrapped.
20000 website scrapping using AWS Batch
Requirement
The customer needed to scrape from a website using input from a file . There must be a retry mechanism. Operating cost should be low.

Solution
1. Create an event on S3 bucket when a new input file is uploaded
2. Trigger an AWS Batch that will 
   a) read input file and create steps based on input file
   b) scrape from target website, retry if required
   c) aggregate collected data and send report
   d) cleanup transient info
3. AWS ECR contained Docker images
4. All notifications are via SNS (user subscribed for SMS and email alert)
5. Batch failure triggers SNS notification
6. Spot instances (can be upto 80% discounted) for AWS Batch

Solution Components:
1. Docker
2. Elastic Container Repository (ECR)
3. AWS Batch. This inturn uses Elastic Container Service (ECS) - Fargate
4. S3
5. Simple Notification Service (SNS)
6. Simple Email Service (SES)
7. Cloudwatch

Result
Over 95% of the records are scrapped.
20000 website scrapping using AWS Batch
Requirement
The customer needed to scrape from a website using input from a file . There must be a retry mechanism. Operating cost should be low.

Solution
1. Create an event on S3 bucket when a new input file is uploaded
2. Trigger an AWS Batch that will 
   a) read input file and create steps based on input file
   b) scrape from target website, retry if required
   c) aggregate collected data and send report
   d) cleanup transient info
3. AWS ECR contained Docker images
4. All notifications are via SNS (user subscribed for SMS and email alert)
5. Batch failure triggers SNS notification
6. Spot instances (can be upto 80% discounted) for AWS Batch

Solution Components:
1. Docker
2. Elastic Container Repository (ECR)
3. AWS Batch. This inturn uses Elastic Container Service (ECS) - Fargate
4. S3
5. Simple Notification Service (SNS)
6. Simple Email Service (SES)
7. Cloudwatch

Result
Over 95% of the records are scrapped.
20000 website scrapping using AWS Batch
Requirement
The customer needed to scrape from a website using input from a file . There must be a retry mechanism. Operating cost should be low.

Solution
1. Create an event on S3 bucket when a new input file is uploaded
2. Trigger an AWS Batch that will 
   a) read input file and create steps based on input file
   b) scrape from target website, retry if required
   c) aggregate collected data and send report
   d) cleanup transient info
3. AWS ECR contained Docker images
4. All notifications are via SNS (user subscribed for SMS and email alert)
5. Batch failure triggers SNS notification
6. Spot instances (can be upto 80% discounted) for AWS Batch

Solution Components:
1. Docker
2. Elastic Container Repository (ECR)
3. AWS Batch. This inturn uses Elastic Container Service (ECS) - Fargate
4. S3
5. Simple Notification Service (SNS)
6. Simple Email Service (SES)
7. Cloudwatch

Result
Over 95% of the records are scrapped.
20000 website scrapping using AWS Batch
Requirement
The customer needed to scrape from a website using input from a file . There must be a retry mechanism. Operating cost should be low.

Solution
1. Create an event on S3 bucket when a new input file is uploaded
2. Trigger an AWS Batch that will 
   a) read input file and create steps based on input file
   b) scrape from target website, retry if required
   c) aggregate collected data and send report
   d) cleanup transient info
3. AWS ECR contained Docker images
4. All notifications are via SNS (user subscribed for SMS and email alert)
5. Batch failure triggers SNS notification
6. Spot instances (can be upto 80% discounted) for AWS Batch

Solution Components:
1. Docker
2. Elastic Container Repository (ECR)
3. AWS Batch. This inturn uses Elastic Container Service (ECS) - Fargate
4. S3
5. Simple Notification Service (SNS)
6. Simple Email Service (SES)
7. Cloudwatch

Result
Over 95% of the records are scrapped.
20000 website scrapping using AWS Batch
Requirement
The customer needed to scrape from a website using input from a file . There must be a retry mechanism. Operating cost should be low.

Solution
1. Create an event on S3 bucket when a new input file is uploaded
2. Trigger an AWS Batch that will 
   a) read input file and create steps based on input file
   b) scrape from target website, retry if required
   c) aggregate collected data and send report
   d) cleanup transient info
3. AWS ECR contained Docker images
4. All notifications are via SNS (user subscribed for SMS and email alert)
5. Batch failure triggers SNS notification
6. Spot instances (can be upto 80% discounted) for AWS Batch

Solution Components:
1. Docker
2. Elastic Container Repository (ECR)
3. AWS Batch. This inturn uses Elastic Container Service (ECS) - Fargate
4. S3
5. Simple Notification Service (SNS)
6. Simple Email Service (SES)
7. Cloudwatch

Result
Over 95% of the records are scrapped.
20000 website scrapping using AWS Batch
Requirement
The customer needed to scrape from a website using input from a file . There must be a retry mechanism. Operating cost should be low.

Solution
1. Create an event on S3 bucket when a new input file is uploaded
2. Trigger an AWS Batch that will 
   a) read input file and create steps based on input file
   b) scrape from target website, retry if required
   c) aggregate collected data and send report
   d) cleanup transient info
3. AWS ECR contained Docker images
4. All notifications are via SNS (user subscribed for SMS and email alert)
5. Batch failure triggers SNS notification
6. Spot instances (can be upto 80% discounted) for AWS Batch

Solution Components:
1. Docker
2. Elastic Container Repository (ECR)
3. AWS Batch. This inturn uses Elastic Container Service (ECS) - Fargate
4. S3
5. Simple Notification Service (SNS)
6. Simple Email Service (SES)
7. Cloudwatch

Result
Over 95% of the records are scrapped.
20000 website scrapping using AWS Batch

Reviews

Changes saved
Showing 1 - 5 out of 18 reviews
Filter reviews by:
5.0
$100.00 USD
Good Work will do business again
System Admin Linux Cloud Computing Amazon Web Services Amazon CloudFormation
User Avatar
Flag of Shakeel J. @sja586fd47c205e1
19 days ago
5.0
$50.00 USD
Very good communication. Dedicated time for delivering the project. I am satisfied. I will work with VisionFirst again in my future projects.
Cloud Computing Azure Docker Kubernetes
S
Flag of Subramanian A. @subranna3
4 months ago
5.0
$268.26 USD
They were able to help me out with a really tricky ElasticSearch problem. I appreciated their expertise in solving our issue! Would definitely work with them again.
Elasticsearch
User Avatar
Flag of Mike K. @mrtsystems
5 months ago
5.0
$100.00 USD
He has excellent skill in AWS. I will hire him again
JavaScript Web Security Amazon Web Services JSON
+1 more
G
Flag of Li G. @Guirong
5 months ago
4.4
$260.00 USD
Great quality of work and reasonable price. Very professional to work with
Java Amazon Web Services Amazon S3
User Avatar
Flag of Jerome D. @ajdel645
10 months ago

Contact VisionFirst Technologies about your job

Log in to discuss any details over chat.

Verifications

Preferred Freelancer
Identity Verified
Payment Verified
Phone Verified
Email Verified
Facebook Connected

Certifications

us_eng_1.png US English 1 97% preferredfreelancer-1.png Preferred Freelancer Program SLA 1 92% c-prog-1.png C Programming 1 85% oauth-v2-1.png OAuth 2.0 1 80% c-prog-2.png C Programming 2 80%

Top Skills

Amazon Web Services
16
Amazon S3 9 JSON 7 JavaScript 4 Shell Script 4

Browse Similar Freelancers

Amazon Web Services Experts in India
Amazon Web Services Experts
Amazon S3 Experts
JSON Developers

Browse Similar Showcases

Amazon Web Services
Amazon S3
JSON
JavaScript
Previous User
Next User
Invite sent successfully!
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2022 Freelancer Technology Pty Limited (ACN 142 189 759)
There is no internet connection
Loading preview