Software Mind SA was a technological leader in the European project WeKnowIt
Internet is a medium of immediate information exchange. Every day it features hundreds news reports about tragedies, calls for help and announcements about missing people. This information, although up-to-date, is often incomplete, unveried and sometimes even untrue, and therefore cannot be used by specialised emergency services.
WeKnowIt project is about making use of collective knowledge. Collective Inteligence which is conceived in the process of cooperation between many groups or individuals. For that purpose innovative technologies will be developed to make it possible to analyse data from different sources (phone, voice, video, text). Their combination will make it pos-sible to develop new information management services and extract information both for end users and organisations. For example, the solution can be used to send automatic SMS notifications to people staying in areas threatened by upcoming flood wave or ordering immediate evacuation.
Benefits from the solution
The idea of the project is to make use of the intelligence eyewitnesses of events have to define the size of threat, using information which is often transmitted by many news channels at the same time. With the IT system, information contained in SMS texts, MMS messages with photos or videos made with mobile phones, blog posts and messa-ges posted on social networking sites, photographs posted in online galleries or information transmitted in a phone talk with emergency services will help carry out activities aimed at solving crisis situations and resulting threats.
All information is analysed by specialised software:
- Element one: picture analysis, recognise buildings in photographs, conclude that the building in the photo is on re (for example)
- Element two: text analysis and monitoring of information coming up on the internet
- Element three: voice analysis of phone conversations
- Element four: video recording analysis
- Element five: pinpoint location where the emergency situation has taken place
Information becomes veried when it has been conrmed by multiple independent sources or one source considered reliable. The potential behind this project is that it bases on analysis of information that can be supplied through many dierent communication channels and many people at any time.
Two solutions will be developed as part of the WeKnowIt project to demonstrate possible applications of the developed techniques and tools: Emergency Response Process and Social Consumer Groups.
Emergency response process
Emergency response process as part of which ordinary people (system users) are able to report threats they have noticed using a variety of means of communication (e-mail, mobile devices, SMS, websites). The system will automatically analyse and classify the reported signals. For instance, automatic speech recognition process will extract names of endangered streets and places from telephone conversations. Similarly, photographs which have been sen-in can be analysed and classified as pictures of eg. one and the same building on fire made from different locations. Automatic classification of such data will make it possible to control the mass of information incoming in an emergency situation and provide appropriate services with aggregated and complete data free of informational hype. The objective of the system is both to streamline the work of emergency services and provide information services to individuals affected by emergency situation (eg. information about available escape routes, nearest hospitals etc.) This solution will be implemented, among other places, in the city of Sheffield which is one of the participants of WeKnowIt project.
Social consumer groups
Solution to be used for publication of information concerning one social group (such as throwing a party) and make it possible to obtain extra meta-information from different sources and group discussions. The objective is to make use of collective intelligence for private, commercial and public benefit purposes.
Software Mind role
Software Mind is responsible for developing the architecture of the entire system which is of key importance to the success of the project:
- Designing the system on all
levels including development of ontology and collective intelligence tools.
- Implementation of proof of concepts and end solutions with tests and
implementation at the consortium level. Integration of websites developed by
- Development and implementation of knowledge base (ie. a
hybrid storage for all kinds of data: semantic, object and multimedia-related).
- Participation in implementation of the front end layer. Maintenance of the
developer environment (repository of code and artefacts, continuous integration