Toward Autonomic Grids: Analyzing the Job Flow with Affinity Streaming
Description
The Affinity Propagation (AP) clustering algorithm proposed by Frey and Dueck (2007) provides an understandable, nearly optimal summary of a dataset, albeit with quadratic computational complexity. This paper, motivated by Autonomic Computing, extends AP to the data streaming framework. Firstly a hierarchical strategy is used to reduce the complexity to ${\cal O}(N^{1+\e})$; the distortion loss incurred is analyzed in relation with the dimension of the data items. Secondly, a coupling with a change detection test is used to cope with non-stationary data distribution, and rebuild the model as needed. The presented approach StrAP is applied to the stream of jobs submitted to the EGEE Grid, providing an understandable description of the job flow and enabling the system administrator to spot online some sources of failures.
| Slides | |
| 0:00 | Toward Autonomic Grids: Analyzing the Job Flow with Affinity Streaming |
| 0:19 | Contents |
| 0:22 | Motivations of Autonomic Computing |
| 0:37 | Goals of Autonomic Computing |
| 0:53 | Autonomic Grid Computing System |
| 1:37 | Contents |
| 1:41 | G-StrAP: relies on Affinity Propagation (AP) |
| 2:48 | From AP to Large-scale Data Streaming (1) |
| 3:45 | From AP to Large-scale Data Streaming (2) |
| 4:42 | Non stationary distribution, continue |
| 5:14 | Self-adaptive change detection test |
| 6:10 | Contents |
| 6:16 | G-StrAP : Multi-scale Realtime Monitor |
| 6:33 | G-StrAP Dashboard for Grid Monitoring (1) |
| 7:10 | G-StrAP Dashboard for Grid Monitoring (2) |
| 7:56 | Contents |
| 7:58 | Discussion and Conclusion |
| 8:58 | Perspectives |
| 9:51 | The End |
Lecture rating
| People found this lecture: | ||
| Worth seeing | ||
| because it is: | ||
| Valuable and informative | ||
| Well presented | ||
| Easily understandable | ||
| Acceptably recorded | ||
| You need to login to cast your vote. | ||
Report a problem or upload files
If you have found a problem with this lecture or would like to send us extra material, articles, exercises, etc., please use our ticket system to describe your request and upload the data.Enter your e-mail into the 'Cc' field, and we will keep you updated with your request's status.
Related content
SEE ALSO:
Link this page
Would you like to put a link to this lecture on your homepage?Go ahead! Copy the HTML snippet !



