Parallel Computing as a Carrier

Assalamualaikum and a very good day to all. 

Based on the research in UK, we can analyse that parallel computing is one of the demand carrier there.

The diagram above shows the statistics of the Parallel Computing Job Demand Trend. We can conclude that, the highest numbers of demand are between Jan 2007 and Jan 2008. What are the criteria that we need to fulfil their requirement?

From NVIDIA web page, the requirement are listed as below :

-A good degree from a leading university in an engineering or computer science related discipline (BS; MS or PhD preferred)
- Strong knowledge of C/C++ and/or Fortran.
- Strong knowledge of programming techniques and algorithms.
- Strong mathematical fundamentals, including linear algebra and numerical methods.
- Experience with parallel programming, ideally CUDA C/C++ and OpenACC.
- Good communication and organization skills, with a logical approach to problem solving, good time management and task prioritization skills.

But, how parallel computing runs their job? Here are two examples how they run the parallel computing.

         

Based on the figure above, a single instance of single application by a basic task runs or MPI (Message Passing Interface) typically runs concurrently run on multiple cores with communication occurring between the process.

Numbering the task in order.  All the task musk be complete first before start with another tasks.  Grouping tasks to specify whether dependent tasks run if parent task fails. By default, the property is not set, in which case all dependent tasks continue to run even if some of the parent tasks fail or get cancel. If you set this property to true, all dependent tasks fail upon the failure of any parent tasks.

Source from :

http://careers.nvidia.com/pljb/nvidia/nvidiaemployment/applicant/jobClick.jsp?count=1&id=10397

http://technet.microsoft.com/en-us/library/ff919630.aspx

http://technet.microsoft.com/en-us/library/ff919681.aspx