SegHidr o
Enhancing SegHidro/BRAMS
experience through EELA
FINAL PRESENTATION
José Flávio M. V. Júnior
Paulo Ricardo Motta Gomes
Laboratório de Sistemas Distribuídos (LSD) – Universidade Federal de Campina Grande (UFCG)
EELA Grid School – December 04, 2006
EGRIS1 Achievements
• Successful gridifying of the meteorologic
application of SegHidro Portal
–
–
–
–
–
Input data uploading module
Input data validation module
Job submitting module
Job monitoring module
Output data retrieving module
• Acquaintance of gLite middleware components
– Helpful on the integration OurGrid/gLite
Laboratório de Sistemas Distribuídos (LSD) – Universidade Federal de Campina Grande (UFCG)
EELA Grid School – December 04, 2006
Overall architecture
CPTEC FTP
LFC
MPI
SegHidr o
Portal
User
RB
WN
CE
SE
L&B
Laboratório de Sistemas Distribuídos (LSD) – Universidade Federal de Campina Grande (UFCG)
EELA Grid School – December 04, 2006
Input data uploading module
• Performed by update_brams_data.sh
• Evoked daily by system scheduler (cron)
lcg-del
ftp_gamrams.sh
lcg-cr
CPTEC FTP SERVER
LOCAL MACHINE
Laboratório de Sistemas Distribuídos (LSD) – Universidade Federal de Campina Grande (UFCG)
SE
EELA Grid School – December 04, 2006
Input data validation module
1
INPUT FILE LIST
2
LFC JAVA API
SegHidr o
2
CORE
3
SE FILE CATALOG (LFC)
3
JOB SUBMITTING MODULE
Laboratório de Sistemas Distribuídos (LSD) – Universidade Federal de Campina Grande (UFCG)
EELA Grid School – December 04, 2006
Job submitting module
• Performed by brams-job-submitter.sh
Edit
1
Parameters
JDL MODEL
SegHidr o
CORE
SHELL
2
EDG-JOB-SUBMIT
JOBID
3
JOB MONITORING THREAD
Laboratório de Sistemas Distribuídos (LSD) – Universidade Federal de Campina Grande (UFCG)
EELA Grid School – December 04, 2006
Job monitoring module
• Performed by job-status-checker.sh
1
jobID
EDG-JOB-STATUS
SegHidr o
CORE
2
SHELL
LOGGING AND BOOKKEEPING
jobStatus
3
OUTPUT DATA RETRIEVING
MODULE
Laboratório de Sistemas Distribuídos (LSD) – Universidade Federal de Campina Grande (UFCG)
EELA Grid School – December 04, 2006
Output data retrieving module
• Performed by job-get-output.sh
jobID + output file list
1
EDG-JOB-GET-OUTPUT
SegHidr o
CORE
2
3
SHELL
RB
boolean
download
False
3
True
Laboratório de Sistemas Distribuídos (LSD) – Universidade Federal de Campina Grande (UFCG)
EELA Grid School – December 04, 2006
Next steps
• Install an EELA site at LSD
• Make new system available to users
• Optimize architecture
– AMGA
– File replication on SE
• Integration between EELA’s gLite and
LSD’s OurGrid
Laboratório de Sistemas Distribuídos (LSD) – Universidade Federal de Campina Grande (UFCG)
EELA Grid School – December 04, 2006
SegHidr o
Thank you!
Merci!
Danke!
Grazie!
Gracias!
Obrigado!
Laboratório de Sistemas Distribuídos (LSD) – Universidade Federal de Campina Grande (UFCG)
EELA Grid School – December 04, 2006
Questions?
Laboratório de Sistemas Distribuídos (LSD) – Universidade Federal de Campina Grande (UFCG)
EELA Grid School – December 04, 2006