Ministry of Social Development and Fight Against Hunger MDS Mapserver technology supports the Data Warehouse of Actions and Investments of the Brazilian Ministry for Social Development and Fight Against Hunger FOSS4G2006 - Free And Open Source Software for Geoinformatics Caio Nakashima September - 2006 Agenda Introduction to the Problems Chosen path Developed products Used Technologies Details of the solutions Future September 2006 Caio Nakashima 2 MDS Current Scenario MDS is an almagamation of previous separated Ministries Low interoperability Many stakeholders (banks, federation members, partners) Formal Links (by law, contracts, agreements) Need for na agile information to the public Different paradigms (concepts, modus operandi) September 2006 Caio Nakashima 3 Scenario: Organizacional Aspects (Aspecto Organizacional) CEF NI SENARC NI NI NI Cadunico DATAPREV SECEX-SecAdj-Gabinete CGI SNAS CIf SAGI SESAN CONAB September 2006 SAIP NI IBGE TSE ASA Caio Nakashima 4 SIG SENARC Social Information Matrix DATA FLOW SIG SNAS SIG SESAN Social MI DW SIG SAIP Gabinete Sec Exec. SIG SAGI (M&A) SAGI September 2006 Caio Nakashima 5 Information Arquitecture P1 P2 P Pn Social Programs P Territory T T Program: xxxxx Beneficiary B B1 nnnnnnnn add B2 nnnnnnnn add B ............................. Bn nnnnnnnnn add September 2006 Caio Nakashima 6 Subsystem Integration P1 P2 P Pn Social Programs P Territory T SOCIAL DATA DICTIONARY T Program: xxxxx Beneficiary B1 nnnnnnnn add B B2 nnnnnnnn add B ............................. Bn nnnnnnnnn September 2006 Caio Nakashima add 7 Benefits Reduced response time to queries from hours and days to minutes and seconds Information access comprehensive to the whole MDS Extracting Business Intelligence to help programs Managers Recording the historical data from the programs Registering knowledge to be used as information source September 2006 Caio Nakashima 8 Introduction to the Problems The managers of the institution Ministry, Secretaries, Directors Majors, Congress people, Senators, Governors Press, Civil Society The need for information from MDS (Ministry of Social Development and Fight Against Hunger) About Social Programs, Beneficiaries, Investments, and so on. September 2006 Caio Nakashima 9 Problems There was not a solid information structure Each department manage their own data, in their own way. There was not a regular information flow between those departments. The urgently need for management reports. September 2006 Caio Nakashima 10 Scenario Caixa Econômica Federal IBGE DATAPREV September 2006 CONAB Spreadsheet TRE Caio Nakashima Tesouro Nacional PNUD REPORTS 11 Chosen path After much pressure and work in manual reports. We developed a private data warehouse only for internal use. External Help Secretaries Support Barriers Pressure against changes September 2006 Caio Nakashima 12 Social Information Data Warehouse Allows to retrieve information about the investments on Social Programs in each city. With the following dimensions: Search Items Geographic Units Territorial Limits Population IDH (Human Development Index) Time September 2006 Caio Nakashima 13 First Screen Select the desired period September 2006 Caio Nakashima 15 Select the variable and Indicators September 2006 Caio Nakashima 16 Select the territory and other filter as Population and HDI September 2006 Caio Nakashima 17 Result in spreadsheet form September 2006 Caio Nakashima 18 Result in card form. Each card per municipality September 2006 Caio Nakashima 19 Another Way to Search Data Viewing data through social program Georeferenced Data Graphics September 2006 Caio Nakashima 20 Bolsa Família coverage September 2006 Caio Nakashima 22 Map Viewer Structure Title (variable) Functionalities (invariable) Analysis Time (variable) Viewing Area (variable) Title (variable) Legend(variable) Number of registers (variable) September 2006 Caio Nakashima 23 Selection of a special area of some social program (Bolsa Familia Program in the area of Sao Francisco River) September 2006 Caio Nakashima 25 Some features of Map Engine Legend and Layer Control Alow change the Interval Turn on or Turn off the Interval The Color of the Interval September 2006 Caio Nakashima 27 Example of some changes September 2006 Caio Nakashima 28 September 2006 Caio Nakashima 29 The Color Pallete The Color Pallet Map Color Border Color Label Color September 2006 Caio Nakashima 31 September 2006 Caio Nakashima 32 September 2006 Caio Nakashima 33 Retrieve Spatial Information Box to bound the search September 2006 Caio Nakashima 35 Search Result Show the selected geographic area All geographic regions that touch or are inside the boundaries of the box. It will open a window with all chosen geographic regions with: The values used to build the map. Link to details of the geographic information. Link to graphic when applied Link to find the location of the region in map. September 2006 Caio Nakashima 36 September 2006 Caio Nakashima 37 Search through the map September 2006 Caio Nakashima 39 Result of the search through the map The chosen region is highlighted It will open a link for the detail of the selected geographic region. Link for the graphics, where they show the evolution of the variable or indicator presented along the time. The values of the variable or indicator of all cities on the borders of the chosen geographic area. September 2006 Caio Nakashima 40 Analysis through graphics Example: Values of the financial help and the amount of beneficiaries through the time of Bolsa Família List of all values that represented in map September 2006 Caio Nakashima 42 Amount of families (beneficiaries) of Bolsa Familia Amount of financial help. September 2006 Caio Nakashima 43 Graphic of financial help for each family Combination of two graphics September 2006 Caio Nakashima 44 Comparing two or more geographic areas This feature allows a comparative analysis between up to three geographic regions. The selection can be done through geographic bound or close analysis values. September 2006 Caio Nakashima 45 Comparing the amount of financial help September 2006 Caio Nakashima 46 Comparing the financial help for each family September 2006 Caio Nakashima 47 Histogram Financial Value Transferred to the cities of Bolsa Familia Program September 2006 Caio Nakashima 48 Histogram Mean value transferred to each family of Bolsa Familia Program in august 2006. September 2006 Caio Nakashima 49 Pen Parade Graphic Financial Value Transferred to the cities. Graphic of 100% of the distribution September 2006 Caio Nakashima 50 Pen Parade Graphic Financial Value Transferred to the cities. Graphic of 90% of the distribution September 2006 Caio Nakashima 51 System Integration From Georeferenced view is possible to access other information about cities in the data warehouse. Example PETI Bolsa – Financial Help for the Cities in October 2005. PETI – Program Against Child Labour September 2006 Caio Nakashima 52 September 2006 Caio Nakashima 53 September 2006 Caio Nakashima 54 September 2006 Caio Nakashima 55 Structure of the Solution Data Source, Social Program Map Viewer Engine Variable or Indicator Choice Period Choice Information Organizer Data Searcher Knowledge Base User Interaction September 2006 Caio Nakashima 56 Ways to feed the map engine Build the query manually. Read the structure of data from database and show the result of the query in a map. User can build the query from available data in data warehouse. September 2006 Caio Nakashima 57 Map Engine Configuration <? /****************************************************************************** Database conection *******************************************************************************/ // IBM Server $mapas_host = "10.68.12.245"; $mapas_port = "5432"; $mapas_dbname = "MI_2005_2006"; $mapas_user = "username"; $mapas_password = "password"; /****************************************************************************** Files path *******************************************************************************/ $mapas_imagePath = "/dados/guilherme/www/projetoMZ/tmp_img/"; $mapas_url = "tmp_img/"; $mapas_ajaxURL = "/mi/projetoMZ/ajaxBusca.php"; ?> September 2006 Caio Nakashima 58 Data Base of the Solution Shape Files Social Programs Data Data SQL Text Configuration Files Social Program Table Information Request Data Warehouse Viewer Social Table September 2006 Caio Nakashima 59 Data Base of the Solution Social Programs Data SQL Spatial Shape Files Data Configuration Social Program Table Files and Spatial Table Information Request Social Map Viewer Engine September 2006 Caio Nakashima 60 Data Base of the Solution SQL Spatial Social Programs Data SQL Text Shape Files Data Configuration Social Program Table Files and Spatial Table Social Program Table Information Request Data Warehouse Viewer Social Map Viewer Social Table September 2006 Engine Caio Nakashima 61 Build the Query Manually September 2006 Caio Nakashima 62 Read the structure of data September 2006 Caio Nakashima 63 September 2006 Caio Nakashima 64 User building the query September 2006 Caio Nakashima 65 Used Technologies Technologies Client Browser IExplorer, Firefox, Mozilla Jbox (Java) JavaScript September 2006 Aplication Server Apache (WEB Server) PHP (4.x) MN Mapserver PHP MapScript Caio Nakashima PostGreSQL PostGis 67 Development Browser used for the tests IExplorer and FireFox. It is required the installation of Java Virtual Machine in the client browser. JBox requires JVM. Development Language PHP 4.x PHP MapScript until 2005 June was not compiled to PHP version 5 MN MapServer does not require PHP MapScript It was used to give more flexibility to the application. September 2006 Caio Nakashima 68 Future tasks Tuning the database retrieve time for each queries. Create new user maps Develop a Graphic Interface to insert new maps Improve the user interface CD with the solutio September 2006 Caio Nakashima 69 Questions Thank You Very Much Caio Nakashima [email protected] [email protected] www.mds.gov.br Staff Caio Nakashima (Map Viewer) Carlos Eduardo de Andrade Brasileiro (DBA) Marcelo Gomes Gadelha (Data Warehouse Viewer) September 2006 Caio Nakashima 70