Multi Charecter Identification For Visually Computer Science Essay

Published: Last Edited:

This essay has been submitted by a student. This is not an example of the work written by our professional essay writers.

India is now home to the worlds largest number of blind people. Over 37 million people across the globe who are blind, from them 15 million are from India. The proposed system is to help the blind to know the letters through voice communication.

In this electromechanical Braille system, the main objective is understand and acknowledgment mobile messages, to eliminate the barriers that prevent visually challenged children and adults for using mobiles. Thus the existing accessibility features were analysed and upon knowing what more is to be done to help them reach the mobiles with easy, all those constrains were taken into account and this system named as "Multi character identification for visually impaired using Braille system", which is aimed at providing a simple, powerful and orthodox platform with which a fully blind and partly blind person use a mobiles as his normal-eyed counterparts do, was designed. This system designed so as to make things easy for them; hence the Braille code and means the use it, all these features retained such as; no special technique or concept is to be learnt by them to use this system.

The Braille system revolutionized written communication for the blind. The 6 dot Braille system widely used in school. In this system all the alphabets (both lower and upper case), numerals (0-9), common punctuations, abbreviations for commonly used words (like, the, but, and etc) are represented by various combinations of six dots arranged in 3 rows and 2 columns.

Normally speech recognition software, audio interface is mostly used features to use computers by the blind. Here the same features are introducing in the mobile with Braille system. In this system, we receive messages using modem. All that messages are recognized by audio interface and sending acknowledgment for that particular message by using speech recognition with help of Braille system. Here the Braille system is use for spell check for the particular message and send to that recipient.

Key words: Braille system, speech synthesis, speech recognition, ARM with GSM



Mobile phone is a very useful invention. Today all the people are using mobile phones for their convenient The mobile phone is a very good technology for communication .Having the mobile phone is a great advantage for communicating with friends and families from anywhere to all over the world .By calling or sending messages from mobile phone we can easily able to connect with others without electricity.

Now a day's SMS (short message service) is the most useful application. Today 80% of mobile phone users are using this data application. But the visually impaired people cannot able to use this application.

In this project the visually impaired people can read message using mobile phone, and also this system help the blind people to send acknowledgment for the current incoming messages .This will be implemented by interfacing the Braille system with mobile phone.

Louise Braille is the father of Braille system. This system is a worldwide system; with the help of this system, all the blind peoples for reading and writing like a normal people.

Braille system:

It was invented by Louise Braille (1809-1852), who was blind and become a teacher of the blind. Braille is the system to write and read the words by touch for the visually impaired people. Old days the Braille system is used only for the reading purpose. Now only the system convert to use both read and write.

It consist of patterns of arranging dots in array manner and all the dots all arranged in 3x2 configuration. Each cell represents a particular letter or symbol and the combination of Braille cells are mention the words or sentences.


There are number of different versions of Braille:

Grade 1 is consists of 26 letters of standard alphabet and punctuation. This is first starting system for the blind people.

Grade 2 is also consists of 26 letters standard alphabet and punctuation. Also in this grade have the contractions. Braille page cannot fit into printout pages. So using contractions we match the Braille and printout pages.

Grade 3 is mainly used for personal letters, diaries and also literature. This type of shorthand written is mostly used for the message applications.

Braille code:

Braille code is the world first binary encoding scheme to represent the letters in the writing system.

The system invented by two parts:

In the French language character encoding is used for mapping characters in the form of six dots. By raising the dots they can identify their characters.

Braille alphabet (English Braille American edition)

Punctuation signs

Today different Braille codes are used to mention the different languages by six bit cells. Because of the six-dot Braille cell only have 63 combinations. In this diagram, some same oriented character omitted based on their context. So only the characters are not mapping to each other letters.


The main objective of this project is blind or partially blind people can understood the messages and give acknowledgment for particular message using mobile as normal people.

III.Existing system

Braille technology is making of revolution among the visually impaired people. This Braille technology allows blind people to do many things like writing, browsing the internet, typing Braille and printing in text document, typing in chat, downloading files, music, using electronic mail and for reading documents. It is also useful for blind students for completing their assignments like a normal students.

Braille is most useful technology for the blind people in communication world. In the existing system message application dose not complete for blind people. In message application the visually impaired people only can able to read the message in on the tactile surface of the display. But the quality of the system is not goo d because the blind people not able to identify the text exactly

IV.Proposed System

This system is mainly developed for mobile application. Here using in this system able to read and write message by Braille module. So only we are implemented all these system functions in to control unit is called keypad.

Control unit have 12 keys (0 to 9, # and *) for controlling the entire system. Each key have specific function in that unit. We are considered the blind people, so only every time when pressing each key, the indication of which key we are pressed that will be indicating in loud speaker.

Fig 1 Block diagram of message application using Braille system

Functions of control unit:

1. Ready to read

2. Reread

3. Delete current message

4. Reply for current message

5. Voice record, Voice record complete

6. Check text

7. Recheck

8. Re-voice record

9. Send message

*. Temperature indication

0. Time indication

#. Date indication

Braille system works in two type of mechanism:

Using an electro-mechanical technique the Braille display is raising dots through holes in a flat surface for displaying Braille characters.

The second mechanism, which is using piezo effect to raises the dots when a voltage applied to it. The crystal is connected to the lever, which is raises the dots. This mechanism is high cost compare to electro mechanical display.


A flapper has high mechanical stability, low actuating voltage, and low price compared piezo-electric mechanism. Each Braille cell has modular unit, called Braille cell module. It consists of six flappers to drive the Braille dots.

A . Flapper actuater:

The flapper works based on the theorem of electromagnetic principle. Inside the enamelled coil there is fixed iron core; flapper actuator acting as a rotatable armature. The enamelled coil is constructed in helix shape and it carries electric current and produces the magnetic field lines. The enamelled coil increases the magnetic field. The pole of iron core is acting as a strong magnetic field. And it attracts the armature for control the Braille pin. This mechanism of flapper acting principle shows in figure 2. Here a yoke is used to fit the iron core and to increase the magnetic field. An armature attractive by iron core and pushes the Braille pin upward. An armature clip has limited degree of freedom (DOF) of armature in one direction.

Fig .2 Flapper actuators and Braille cell mechanism.

Braille pins and flappers are depends on the number of Braille dot's. The flapper has two opposite operations in this technique. One is no current passes through the enamel coil and no magnetic force is created to attract the armature. Second condition is the enamel carrying current, the current passes through the enamel coil, and the armature is attracted by upwards because of lever mechanism. The point e2 in armature is clipped by armature clip and that armature rotate in z-axis because of DOF. Point e3 is lifted to contact Braille pin when the point e1 attracted to iron core. Finally Braille pin pushes upwards.

The angle between e1e2 and e2e3 can change because of vertical stroke at point e3. e2e3 is an horizontal position, when the flapper is not carrying current and that time small changes in angle between vertical line and e1e2.

The angle R can be estimated easily when the stoke move upwards and reach 0.7mm. This specific length ratio is to declare the upward stroke of Braille pin to three time of the air gap between the armature and iron core. The small space of air gap in the flapper will be used by this design to provide a large stoke of Braille pin. Main advantage of this air gap is to reduce the current and for less heat generation.

B . Fabrication of Braille cell module and Braille display:

According to types of armature there are two types of armature, and according to their lengths three type of Braille pin are there. The variety of flapper and Braille pins are used to specialized design and fitting in Braille cell module. Here Braille cell mechanism has six Braille pins and six flappers. The figure 3 shows a Braille cell module.

Fig .3 Fabrication of Braille cell module

The full function of Braille cell shows in the figure 2. Six flappers are in the circuit board with tactile surface. And the tactile surface has six holes for holding six Braille pins. The uses of finger tip on the surface, we can identify which pin is to be raised and which letter are mentioned.



Refreshable Braille specifications are listed in below specification table. The values are listed below are best fit value for current standard Braille system.

The top of the Braille dots are domed. The each domed has unspecified radius of curvature.

When dot is raised, the particular dot should be supported by force of> 25 grams.



When the Braille reader touch the surface, the Braille pin should provide a minimum of 20 grams lifted force, while depressed <0.1 mm from its top height.

Dot height should be uniformly for adjacent dots: ±0.05 mm.

Minimum displacement of the un-raised dot in below reading surface value: 0.025 mm.

Measuring of Braille line spacing and height using the centres of a top dot of the cell and also consider vertically adjacent cell.

Braille concept also used in tactile display, if it has additional dots to fill in the gaps of between Braille cells and Braille graphs between cells within cells of each line.


Speech synthesis is the process of developing a human speech in an artificial manner. This system is called speech synthesizer. It can be implemented in hardware or software. Here, text to speech (TTS) system used to convert the normal text message into speech. The relevant speech for each text already created and stored in the data base. Each system has different size of data base unit; the speech unit that stored in phones or diphones, but it may lack clarity of output.

Diphone synthesis is recording a transition between the phones. Number of diphones depends on the language content. These diphones are used to store the words and improve the quality of the output of speech. Synthesizer is a alternatively used to identify the model vocal tract and also creative the completely synthetic of other human voice output.

The quality of this system increased when the similarity of human voice into the database and ability to understood the voice. This system mostly used by the visually impaired people to reading the message and computer documents. The figure 4 shows the block diagram of speech synthesis.




Braille dot base diameter



Dot height



Height of 8 dot Braille cell lines



Distance between centers of corresponding dots in the same cell



Distance between centers of corresponding dots in horizontally adjacent cells



Height of 6 dot Braille cell lines



Fig.4 Speech synthesis

1-utterance composed of words. 2-utterance composed of phonemes. A text-to-speech system (or "engine") is composed of two parts:

A front-end  2) A back-end

The front-end has two major tasks:

1 Front end 2 back end

First, it converts the text message (numbers, abbreviations) into equivalent of written out words. This process is called pre processing. The front end assigns phonetic transcriptions and that converts into the corresponding speech, also match to the system database; the process of converting phonetic transcriptions into words is called grapheme-to-phoneme conversion. Finally in the front end phonetic transcriptions converts output as symbolic representation.

The back end is the output end; this is used symbolic linguistic representation into sound. in this system the corresponding output speech is delivered in the speaker.


Here speech recognition is the translation of pronounced words into text message. It is also called automatic speech recognition or speech to text (STT).

This is a computer technology that is used to recognize and understand the input speech, by using digitizing and matching with the database. Now a day's all the available devices are speaker dependent, it can recognize one or two person only. Also recognize discrete speech then normal speech. This technology is mainly used for helping people in working around their disabilities.

Fig .5 speech recognition block diagram

In this project STT using message application is mainly for helping visually impaired people; it convert the input speech signal into corresponding text message. Before using this technology, we supposed to improve the quality of the system by training with specific person voice in the database; it is called "speaker dependent" system and it gives more accurate transcription. The system will not be trained means that is called as speaker independent systems.

Natural intonation for the synthesised speech will be generated by prosody generator. A flexible pitch contour is selected to suit the type of the sentence from the database. Figure 5 is shows the block diagram of speech recognition.

For a given input text message, intonation for the sentence is determined based on nature of the sentence and then it generating the corresponding pitch contour; the speech units extracted from system database. Pitch and time scale changes are collect out in according to the pitch contour. Finally, trained speech units are performed to produce speech of the output.


Still now Braille technology is used for the blinds by reading purpose. But here, using Braille system both reading and replying the messages as possible by visually impaired people. In this project using Braille technology the blind people can access the message application in mobiles as a normal people. Using this system the uneducated people also may use the message application in mobiles as possible.


[1]. Jussi Rantala, Roope Raisamo, Jani Lylykangas, Veikko Surakka, Jukka Raisamo, Katri Salminen,Toni Pakkanen, and Arto Hippula," Methods for Presenting Braille Characters on a Mobile Device with a Touchscreen and Tactile Feedback" IEEE TRANSACTIONS ON HAPTICS, VOL. 2, NO. 1, JANUARY-MARCH 2009.

[2]. Fung-Huei Yeh, Huoy-Shyi Tsay, Shih-Hao Liang" Human computer interface and optimized electro-mechanical design for Chinese Braille display" Mechanism and Machine Theory 43 (2008) 1495-1518.

[3]. Jun Su Lee and Stepan Lucyszyn, Senior Member, IEEE" A Micromachined Refreshable Braille Cell" JOURNAL OF MICROELECTROMECHANICAL SYSTEMS, VOL. 14, NO. 4, AUGUST 2005.

[4]. Jiung-yao Huanga,*, Ming-Chih Tungb, Kuei Min Wangc, Kuo-Jui Changc "A user interface for the visual-impairment" SCIENCE @DIRECT, Displays 25 (2004) 151-157

[5]. J. Mennens, L.v. Tichelen, G. Francois, J.J. Engelen, "Optical recognition of Braille writing using standard equipment", IEEE Transactions on Rehabilitation Engineering 2 (4) (1994).