Deep Q network

Job Description:

The aim of this project is to develop a reinforcement learning agent that aims at the target container and pours all the objects into it without spillage. You are provided a scene with two cups and two cubes.

If you run the code, the cup should start rotating at a velocity randomly chosen from a predefined set (thee velocities are more diverse than in part two). Use the provided functions to move the pouring cup horizontally while rotating it.

Action Space:

The source cup can be moved along the X-axis by selecting an action from a predefined set [-2, -1,0, 1, 2]. You don’t have to move the cup in any other axis.

State Space:

The state space involves:

The position of two cubes

The position of source cup

Velocities of the two cubes(optional)


the Q-Learning algorithm to develop the Q-table. For most problems, it is impractical to represent the Q-function as a table containing values for each combination of state and action. Because of that, in this part, you have to train a Deep Q-Network to estimate the Q-values.


Submit your training and testing code

Submit a video that shows cubes are falling to the target after you run your code

Submit a .txt file that contain the log of the training, including the accumulated rewards for each episode, TD errors for each DQN update

Submit a .txt file with the following result:

How many times all the cubes fell successfully to the target in 100 trials if your state space consists only cup position?

How many times all the cubes fell successfully to the target in 100 trials if your state space consists both cup position and two cube’s position?

Skills: Neural Networks, Deep Learning, Python, Machine Learning (ML)

About the Client:
( 0 reviews ) Tampa, United States

Project ID: #35343335

Awarded to:


Hi, How are you? Very happy to bid your project because my skills are fitted in your project. I have 8 years experience in Machine learning ,Deep learning ,NLP and AI. I am very familiar deep Q learning. If you send t More

$100 USD in 2 days
(53 Reviews)

4 freelancers are bidding on average $175 for this job


Greetings I saw your project and as an expert in Python/ML/AI/DL I am sure I can do your task. I have previously worked on various state of the art deep learning projects which includes making models for text, music in More

$200 USD in 7 days
(16 Reviews)

Hello, I have rich experience in Python coding for Q-learning. I have read all your explanations carefully and fully understand your requirements. So I am sure I can give you correct and good results. I would appreciat More

$300 USD in 3 days
(0 Reviews)

Hi, I have master's level qualification in AI/ML/DL and 5 years of industry experience. I have read your description. You need to build a Q-learning NN for your pouring agent. I can help you with this project. Let's d More

$100 USD in 7 days
(0 Reviews)