Skip to main content

Need For a Simple Distributed Computing Tools

I have been working on a few hobby project these days. while going through,I came across two key challenges.

Challenge One

"The Need to tap in to parallel processing power of all the resources one might have in a simple way"

Assume the scenario of a person who is in a need to jump start a research activity/ some computationally intensive task, which needs a large computing power & resources. And he or she is in such a situation that they want to be able in include resources in much more dynamic way & is on a Mobile or Adhoc network where anything can happen. At the very same time i don't want to ignore the point that these days even our mobile devices have turned so powerful (a typical arm cpu of Samsung s4 will churn out 49 Gigaflops). And the overall system should be simple to use understand & operate. I came across a thess work Self organised software agents where the agent programs are designed in such a way that they understands the environment & behaves accodringly

Challenge Two

Flexibility to code ones solution in a known language & that it can be executed in massively parallel way. 
A simple solution found was to allow the algorithm to be build as blocks of programs. each block does a single job & uses a secondary scripting to define how the blocks of program be executed each block will be placed on a dependency graph, where the program starts from its start block and travels to stop block, which is as simple as defining a flow chart. To achieve parallelism each block can tell its either its a sequential block or a parallel block. Each block can issued new jobs which will be be en-queued in to the graph & executed

So the end solution is two tools in which 

one is software agents & the other one is a tool to generate or script the job for agent

when is comes to distributed computing two key factors controlling its performance is 

1. location of data or information
2. location of the program or algorithm which has to process the data

This is being resolved as program are written in blocks or small program chuncks
A global & local data pools



This was the story behind part for Acompute.

Labels:

Comments

Post a Comment

Popular posts from this blog

Interview experience

Recently,  I happen to attend interview for software engineer by a reputed engineering firm.  My recent career break made it harder for me to find some good job.  Earlier I want qualified for good job due to my education & now due to career break.  It seems like I'm also facing usual chicken and egg problem. But I find this shocking these industry people are basically concerned about knows language rather than knowing how to use the programming language &  effectively share ideas. I happen to observe certain interview sessions & facts going on while I was waiting in interviewing session room for my interview to happen Let me start with mine. It's always good to have a view about oneself before Judging others.  I passed two rounds of technicals &  was kicked out just by the first question in third round. And do you want to know what was that question? "Do you have worked using mfc???" Answered honestly as No.  & the reply I g...
Post a Comment
Read more

The Indian supremacy theory.

The I ndian supremacy theory : I believe We Indians are supreme above every other human races in the world cuz we are more humane, we are open to incorporate other cultures evolve & adapt to take in the goodness from others & also share what's good in ours. We are more humane & we care for our family & love them more than anything else in the world. We are superior cuz we don't separate ourselves from other people on the basis caste Creed religion nationality. We belong to a bigger United world. Working together for a common goal "betterment of life of everyone in this world & other". By referring one as an "Indian" we point to those people who, no matter where, when, how he or she born or live,  live a life of loving & caring, irrespective & above of all the caste Creed classification, working for the betterment of life & there by the Nature and the Oneness . Don't separate ourselves from other cuz, we are different...
Post a Comment
Read more

Mission Accomplished

Due to certain circumstances the mission took a hard turn , moved from Thiruvananthapuram to Sandiago department, the main reason behind the shift is dataset and information availabilty of various factors such as twitter, drug stats, education etc etc. In short the project had been entitled as HYBRID APPROACH TO CRIME PREDICTION USING DEEP LEARNING. And below I will show you a glimpse of output which we got so far . this is so far away from the aim. Shows most probable location of crime on map on given unit time frame Probability of crime at a given hotspot The algorithm is far away from complete but its possible to construct one 
Post a Comment
Read more