Final Project Report Group B5
Final Project Report Group B5
CERTIFICATE
This is to certify that the project report entitled,
Hand - Gesture Controlled Arm Robot
Submitted by
Name of students Roll Number
M.R.O. Aswath Prakash 2184025
Dinesh Panicker 2184018
Darsh Kapoor 2184017
It is a bonafide work carried out by these students under the guidance of RAGESHRI
BAKARE at MIT SOE during the academic year 2020-2021. It has been accepted and
approved for the partial fulfillment of the requirement of MIT ADT University, Pune, for the
award of the degree of Bachelor of Technology (ECE).
This work and project has not been earlier submitted to any other institute or University for the
award of any degree or diploma.
Prof. Rageshri Bakare Prof. Dr. V.V Shete Prof. Kishore Ravande
Guide HOD Principal
Dept. Of ECE Dept. Of ECE MITSOE, Pune
ACKNOWLEDGEMENT
Getting a project done reflects the proverbial saying “Success is a marathon and not a sprint”.
Dedication and perseverance when supported by inspiration and guidance leads to success.
We’re highly indebted to Prof. Rageshri Bakare for their guidance and constant supervision as
well as for providing necessary information regarding the project & also for their support in
completing the Mini Project work. In true sense it was privilege for us to have him as our guide
and we felt highly honoured working under him .Prof. (Dr.) V.V Shete, Head, Dept. of
Electronics & Communication Engineering, has been a constant source of inspiration to us.
Both are responsible for giving us the confidence and courage throughout execution.
We do not have words to express our sincere thanks to Prof. (Dr.) Kishore Ravande, Principal-
MIT School of Engineering for their constant support and encouragement throughout the Mini
Project work. We also acknowledge the help of family, friends and all those who have
encouraged and helped us directly or indirectly with our work but whose contribution we may
have failed to mention inadvertently.
LIST OF FIGURES
Figures Pg No.
Fig. 2 Encoder 6
Fig. 6 Decoder 8
TABLE OF CONTENTS
Declaration ------------------------------------------------------ (i)
Certification ---------------------------------------------------- (ii)
Acknowledgement ------------------------------------------------(iii)
List of Figures --------------------------------------------------- (iv)
Table of Contents ----------------------------------------------- (v)
Abstract ---------------------------------------------------------- (vi)
Chapter 1: Introduction
1.1 Introduction------------------------------------------------------------------------01
1.2 Problem Statements---------------------------------------------------------------02
ABSTRACT
Gesture Controlled Robot is a robot which can be controlled by simple gestures. The user just
needs to wear a gesture device which includes a sensor. The sensor will record the movement
of hand in a specific direction which will result in the movement of the robot in the respective
direction. The robot and the Gesture device are connected wirelessly via radio waves. The
wireless communication enables the user to interact with the robot in a more friendly way.
CHAPTER 1:
INTRODUCTION
1
MIT School of Engineering, Department of ECE
Hand Gesture Controlled Arm Robot
PROBLEM STATEMENT
Gesture control method will be adopted in this project. To design and implement a manually
controlled robot capable of moving around to grip and lift the objects.
2
MIT School of Engineering, Department of ECE
Hand Gesture Controlled Arm Robot
CHAPTER 2:
To Identify and select the proper microcontroller and sensor which is suitable for our project,
Paper referred from Jegede, Awodele, Ajayi and Ndong. “Development of a Microcontroller
Based Robotic Arm” in Computer Science and IT Education Conference.
To design the robot grip, Paper referred from R. Chouhan, F. Kanwal, S. Ali, and N. Ali,
“Design and Development of a Prototype Robotic Gripper,” in International Conference on
Robotics and Emerging Technologies in Engineering, 2014, pp. 317–320.
For the various design, calculations and analysis of the robotic arm, paper referred from Md.
Anisur Rahman , Alimul Haque Khan , Dr. Tofayel Ahmed , Md. Mohsin Sajjad, ”Design,
Analysis and Implementation of a Robotic Arm- The Animator”, vol 2, 2013.
For the Robot arm design, paper referred from Ramish, Hussain & Kanwal, “Design of a 3
DoF Robotic Arm” in Innovative Computing Technology (INTECH 2016).
To control the robot wirelessly with the help of RF Communication, Paper referred from
Ahmed, Ramli, Fazlina , “Wireless Hand Gesture Controlled Robotic Arm Via NRF24L01
Transceiver” in IEEE 9th Symposium on Computer Applications and Industrial Electronics.
For the hand gesture control, Paper referred from Bin Fang, Di Guo, Funchun Sun & Yupei
Wu, “A robotic hand-arm teleoperation system using human arm/hand with a novel data glove”
in IEEE International Conference on Robotics and Biometrics.
3
MIT School of Engineering, Department of ECE
Hand Gesture Controlled Arm Robot
RF Encoder
Transmitter
Gesture recognition technologies are much younger in the world of today. At this time there is
much active research in the field and little in the way of publicly available implementations.
Several approaches have been developed for sensing gestures and controlling robots. Glove
based technique is a well-known means of recognizing hand gestures. It utilizes a sensor
attached to a glove that directly measures hand movements.
A Gesture Controlled robot is a kind of robot which can be controlled by hand gestures and
not the old fashioned way by using buttons. The user just needs to wear a small transmitting
device on his hand which includes a sensor which is an accelerometer in our case.
Movement of the hand in a specific direction will transmit a command to the robot which will
then move in a specific direction. The transmitting device includes accelerometer and an
Encoder IC which is used to encode the four bit data and then it will be transmitted by an RF
Transmitter module.
4
MIT School of Engineering, Department of ECE
Hand Gesture Controlled Arm Robot
RF 8051
Decoder motor
Control
Receiver uC s
Gripper and
movement
of Arm
Servos
At the receiving end an RF Receiver module will receive the encoded data and decode it by
using a decoder IC. This data is then processed by a microcontroller and passed onto a motor
to rotate it in a special configuration to make the robot move in the same direction as that of
the hand.
5
MIT School of Engineering, Department of ECE
Hand Gesture Controlled Arm Robot
2. Encoder (HT12E)
Fig. 2 Encoder
HT12E is a 212 series encoder IC (Integrated Circuit) for remote control applications. It is
commonly used for radio frequency (RF) applications. By using the paired HT12E encoder
and HT12D decoder we can easily transmit and receive 12 bits of parallel data serially. HT12E
simply converts 12-bit parallel data in to serial output which can be transmitted through a RF
6
MIT School of Engineering, Department of ECE
Hand Gesture Controlled Arm Robot
transmitter. These 12-bit parallel data are divided into 8 address bits and 4 data bits. By using
these address pins we can provide 8 bit security code for data transmission and multiple
receivers may be addressed using the same transmitter.
The ADC0809 data acquisition component is a monolithic CMOS device with an 8-bit analog-
to-digital converter, 8-channel multiplexer and microprocessor compatible control logic. The
8-bit A/D converter uses successive approximation as the conversion technique. The converter
features a high impedance chopper stabilized comparator, a 256R voltage divider with analog
switch tree and a successive approximation register. The 8-channel multiplexer can directly
access any of 8-single-ended analog signals. The design of the ADC0809 has been optimized
by incorporating the most desirable aspects of several A/D conversion techniques. The
ADC0809 offers high speed, high accuracy, minimal temperature dependence, excellent long-
term accuracy and repeat-ability, and consumes minimal power.
• Operates Ratio-metrically or with 5 VDC or Analog Span Adjusted Voltage
Reference
• No Zero or Full-Scale Adjust Required
• 8-Channel Multiplexer with Address Logic
• 0V to VCC Input Range
• Outputs meet TTL Voltage Level Specifications
• ADC0809 Equivalent to MM74C949-1
7
MIT School of Engineering, Department of ECE
Hand Gesture Controlled Arm Robot
Radio frequency (RF) is a rate of oscillation in the range of about 3 KHz to 300 GHz, which
corresponds to the frequency of radio waves, and the alternating currents which carry radio
signals. Although radio frequency is a rate of oscillation, the term "radio frequency" or its
abbreviation "RF" are also used as a synonym for radio – i.e. to describe the use of wireless
communication, as opposed to communication via electric wires The RF module is working on
the frequency of 315 MHz and has a range of 50-80 meters.
• RX receiver & TX Transmitter Frequency Range: 433Mhz
• Operating Voltage: 5V
• Low Power Consumption
• Easy for RF based application
• Very Stable Operating Frequency
• ASK Modulation
5. Accelerometer (ADXL335)
6. Decoder (HT12D)
Fig. 6 Decoder
8
MIT School of Engineering, Department of ECE
Hand Gesture Controlled Arm Robot
HT12D is a 212 series decoder IC (Integrated Circuit) for remote control applications
manufactured by Holtek. It is commonly used for radio frequency (RF) wireless applications.
By using the paired HT12E encoder and HT12D decoder we can transmit 12 bits of parallel
data serially. HT12D simply converts serial data to its input (may be received through RF
receiver) to 12-bit parallel data. These 12-bit parallel data is divided in to 8 address bits and 4
data bits.
• Operating voltage: 2.4V~12V
• Low power and high noise immunity CMOS technology
• Low standby current
• Capable of decoding 12 bits of information.
• HT12D: 8 address bits and 4 data bits.
A servo motor is a type of motor that can rotate with great precision. Normally this type of
motor consists of a control circuit that provides feedback on the current position of the motor
shaft, this feedback allows the servo motors to rotate with great precision.Micro Servo Motor
SG90 is a tiny and lightweight server motor with high output power. Servo can rotate
approximately 180 degrees (90 in each direction), and works just like the standard kinds but
smaller.
• Operating Voltage : 3.0V-7.2V
• High resolution
• Accurate positioning
• Fast control response
• Constant torque throughout the servo travel range
• Excellent holding power
9
MIT School of Engineering, Department of ECE
Hand Gesture Controlled Arm Robot
CHAPTER 3:
DESIGN, DEVELOPMENT & DRAWINGS
3.1 SYSTEM INTEGRATION-
This digital signal is the input to the encoder IC. The input to the encoder is parallel while the
output is a serial coded waveform which is suitable for RF transmission. The Transmission
Enable (TE) pin is grounded to ensure continuous transmission of data bits. The coded data
will be passed onto the RF module.
The RF transmitter modulates the input signal using Amplitude Shift Keying (ASK)
modulation. It is the form of modulation that represents digital data as variations in the
amplitude of a carrier wave.
10
MIT School of Engineering, Department of ECE
Hand Gesture Controlled Arm Robot
The RF modules works on the frequency of 315MHz. It means that the carrier frequency of
the RF module is 433MHz. The RF module enables the user to control the robot wirelessly
and with ease.
This transmitted signal is received by the RF receiver, demodulated and then passed onto the
decoder IC. The decoder IC decodes the coded waveform and the original data bits are
recovered. The input is a serial coded modulated waveform while the output is parallel. The
pin 17 of the decoder IC is the Valid Transmission (VT) pin. A led can be connected to this pin
which will indicate the status of the transmission. In the case of a successful transmission, the
led will blink.
The parallel data from the decoder is fed to the port 2 of the microcontroller. This data is in the
form of bits. The microcontroller reads these bits and takes decisions on the basis of these bits.
What the microcontroller does is, it compares the input bits with the coded bits which are burnt
into the program memory of the microcontroller and outputs on the basis of these bits. Port 1
of the microcontroller is used as the output port. Output bits from this port produce a PWM
signal which in turn, controls the servos.
At a dead stop, a PWM signal of ~8% duty cycle is produced to keep the servos at 0 deg. If a
PWM voltage is applied, in accordance with the duty cycle, the servos would be controlled. If
the hand moves right or left, accordingly the servos would move the arm right and left
accordingly. There are, in total 4 servos which control the overall movement of the arm on the
basis of our hand gestures.
11
MIT School of Engineering, Department of ECE
Hand Gesture Controlled Arm Robot
12
MIT School of Engineering, Department of ECE
Hand Gesture Controlled Arm Robot
D3 D2 D1 D0
Left 135-255 X 1 X X
Right 0-120 1 X X X
Centre 120-135 0 0 X X
D3 D2 D1 D0
Forward 135-255 X X X 1
Backward 0-120 X X 1 X
Centre 120-135 X X 0 0
13
MIT School of Engineering, Department of ECE
Hand Gesture Controlled Arm Robot
2. Receiver Section
Direction Received Bits Action
D3 D2 D1 D0
14
MIT School of Engineering, Department of ECE
Hand Gesture Controlled Arm Robot
15
MIT School of Engineering, Department of ECE
Hand Gesture Controlled Arm Robot
3.2 Flowchart
1. Transmitter Section:
START
DEFINE TIMER
INTERRUPT FUNCTION
DEFINE A SOFTWARE
DELAY FUNCTION
16
MIT School of Engineering, Department of ECE
Hand Gesture Controlled Arm Robot
STOP
17
MIT School of Engineering, Department of ECE
Hand Gesture Controlled Arm Robot
2. Receiver Section:
START
DEFINE A FUNCTION TO
LOAD THE TIMER VALUES
AND DELAY
END
18
MIT School of Engineering, Department of ECE
Hand Gesture Controlled Arm Robot
3.3 Calculations
(1) 8 bits Auto reload mode.
To calculate Timer generated delay.
= 5 us
= 251D =FBH
Encoder calculation
Condition to be followed:
RS ~ 2 RTC
So, we took
RTC = 10k
CTC = 1pf
Formula to calculate
= 43.47 khz
19
MIT School of Engineering, Department of ECE
Hand Gesture Controlled Arm Robot
RX IF Frequency : 1MHz
RX Operating Voltage : 5V
TX Supply Voltage : 3V ~ 6V
20
MIT School of Engineering, Department of ECE
Hand Gesture Controlled Arm Robot
CHAPTER 4:
The Accelerometer analog values are converted to digital by the ADC0808 and are sent to the
encoder for transmitting it to the 433Mhz Transmitter.
8051 acts as a comparator and reduces the 8-bit values to 4-bit code-word. The port 1 is used
to sends the 4 bit redundant values to the encoder.
2. Receiver Section:
The decoder would decode the bits and move the servo. Now, in proteus software, we cant
simulate two microcontrollers simultaneously, so I’ve used the bit-toggle to generate the
decoder bits.
We have refereed from the code section the movement of servos with the given logic. Here
P2.7-P2.4 stand for bits D3-D0 respectively.
21
MIT School of Engineering, Department of ECE
Hand Gesture Controlled Arm Robot
22
MIT School of Engineering, Department of ECE
Hand Gesture Controlled Arm Robot
23
MIT School of Engineering, Department of ECE
Hand Gesture Controlled Arm Robot
CHAPTER 5:
We achieved our objective without any hurdles i.e. the control of a robot using gestures. The
robot is showing proper responses whenever we move our hand. The robot only moves when
the accelerometer is moved in a specific direction.
Future Scope:
1. 3 degree of freedom can be used, which allows robot arm to move in X, Y, Z direction.
2. Secondly, as we are using RF for wireless transmission, the range is quite limited;
nearly 50-80m. This problem can be solved by utilizing a GSM module for wireless
transmission. The GSM infrastructure is installed almost all over the world. GSM will
not only provide wireless connectivity but also quite a large range.
3. Thirdly, an on-board camera can be installed for monitoring the robot from faraway
places. All we need is a wireless camera which will broadcast and a receiver module
which will provide live streaming.
Application:
1. Industrial:
Such arms may prove handy in such sectors where the precision has to be adjusted from
time to time. This Arms make job of the controller easier and have the capability of
being operated at faster speed than the traditional robotics arms used in the industries.
A combination of the traditional and gesture-controlled robotics arm may prove to be
very handy providing the arm both flexibility as well as accuracy.
2. Military:
It can also be used for military purpose to perform operation on explosives as gesture
controlled robotic arm can also help the bomb squad to detonate or defuse the bomb
without involving risk to their life
3. Space:
Gesture Controlled Robotic arm can also help the astronauts to repair or pick-up objects
in zero gravity without going outside the space craft, where movement of human being
is quite difficult and is dangerous for human life.
24
MIT School of Engineering, Department of ECE
Hand Gesture Controlled Arm Robot
4. Scientific:
Gesture control mobile robotic arm can help the scientist performing hazardous
experiment in safer way by using robotic arm to pick the Dangerous liquids. This can
also help scientist to perform the liquids which are highly flammable.
5. Medical:
Robot can be used by doctors to perform surgical operations at distant places. Such a
technology can prove to be helping hand to physically disabled people or extremely old
people.
Reference:
1. https://ieeexplore.ieee.org/document/8743772
2. https://circuitdigest.com/microcontroller-projects/diy-hand-gesture-controlled-
robotic-arm-using-arduino-nano
3. https://ieeexplore.ieee.org/document/7419712?arnumber=7419712&queryText=hand
%20robotic%20arm&newsearch=true
25
MIT School of Engineering, Department of ECE