Skip to main content

Need For a Simple Distributed Computing Tools

I have been working on a few hobby project these days. while going through,I came across two key challenges.

Challenge One

"The Need to tap in to parallel processing power of all the resources one might have in a simple way"

Assume the scenario of a person who is in a need to jump start a research activity/ some computationally intensive task, which needs a large computing power & resources. And he or she is in such a situation that they want to be able in include resources in much more dynamic way & is on a Mobile or Adhoc network where anything can happen. At the very same time i don't want to ignore the point that these days even our mobile devices have turned so powerful (a typical arm cpu of Samsung s4 will churn out 49 Gigaflops). And the overall system should be simple to use understand & operate. I came across a thess work Self organised software agents where the agent programs are designed in such a way that they understands the environment & behaves accodringly

Challenge Two

Flexibility to code ones solution in a known language & that it can be executed in massively parallel way. 
A simple solution found was to allow the algorithm to be build as blocks of programs. each block does a single job & uses a secondary scripting to define how the blocks of program be executed each block will be placed on a dependency graph, where the program starts from its start block and travels to stop block, which is as simple as defining a flow chart. To achieve parallelism each block can tell its either its a sequential block or a parallel block. Each block can issued new jobs which will be be en-queued in to the graph & executed

So the end solution is two tools in which 

one is software agents & the other one is a tool to generate or script the job for agent

when is comes to distributed computing two key factors controlling its performance is 

1. location of data or information
2. location of the program or algorithm which has to process the data

This is being resolved as program are written in blocks or small program chuncks
A global & local data pools



This was the story behind part for Acompute.

Comments

Popular posts from this blog

Start

Welcome to GeekyJackie  well this is my technical blog where I intend to showcase my Technical Ideas, project etc.... And its Day One.  A Little About My self will do great right ? Myself JazeemAzeez  AKA Jackie. Well Right now im a Student doing Post-graduation in CSE(Computer Science and Engineering ) @ Hindustan University Chennai. I feel Sometimes a little Geeky/Nerdy. This is my final year of PG right now doing . About the project  A long story in short.During PG we students can choose our project under the domain which we like to specialize. so Initially i Had Chosen Network security Domain & Later on due to Circumstances I Had been re allocated to Specialize in Data Mining & Far most Shocking was that I had Go a Guide Who is know for his perfectionism. Data Mining is a field or paper which I really intended to avoid. My previous Guide Motivated me to do it, I had started searching for a Topic. basically it was ...
Going OpenSource ... Recently I have been thinking, I have finished several projects , but whats my contribution to the public cuz most of  the works have been for clients... So gonna start uploading some of the nightly builds over there