FORK-JOIN QUEUE MODELING AND OPTIMAL SCHEDULING IN PARALLEL PROGRAMMING FRAMEWORKS

ABSTRACT
MapReduce framework is widely used to parallelize batch jobs since it exploits a high degree of multi-tasking to process them. However, it has been observed that when the number of servers increases, the map phase can take much longer than expected. This thesis analytically shows that the stochastic behavior of the servers has a negative effect on the completion time of a MapReduce job, and continuously increasing the number of servers without accurate scheduling can degrade the overall performance. We analytically model the map phase in terms of hardware, system, and application parameters to capture the effects of stragglers on the performance. Mean sojourn time (MST), the time needed to sync the completed tasks at a reducer, is introduced as a performance metric and mathematically formulated. Following that, we stochastically investigate the optimal task scheduling which leads to an equilibrium property in a datacenter with different types of servers. Our experimental results show the performance of the different types of schedulers targeting MapReduce applications. We also show that, in the case of mixed deterministic and stochastic schedulers, there is an optimal scheduler that can always achieve the lowest MST.

KEYWORDS
Stochastic processes, Computational model, Delayed Tailed Distribution, Optimal scheduling, Cloud computing, Synchronization, Queuing Theory, MapReduce, Stochastic Modeling, Performance Evaluation, Fork-Join Queue.

Comments

Post a Comment

Popular posts from this blog

Unlimited Yahoo Mail Service is FAKE!

Image
Yahoo Mail service problem! The huge capacity is fake! It's not unlimited! It doesn't show old emails. It just tel you: There appears to be a problem loading the email "Taxes".  Retry or Sorry, we're still having problems loading this message. This is likely a temporary issue due to a connection problem or an email with large attachments. Check your connection and try again, or try back again shortly. If you're still seeing this error, visit  Help  for troubleshooting instructions or to contact us. Error code: 44
Read more

Computer Vision Keywords

2D attacks 2D Face 2D Face Authentication 3D blood flow estimation 3D Face 3D Face Localisation 3D face model 3D face recognition 3D localization 3D Masks 3D model base indexing 3D object recognition abnormality detection accelerated exact k-means Accent Identification Accented speech Accentual mismatch accessible games acoustic frequency Acoustic model adaptation acoustic modeling Acoustic reverberation sparsity models Acoustic reverberation structures Acoustic signal processing acoustic stream acquisition ACT metric activation function active shape model activity Actor–critic Ad hoc array calibration Ad hoc microphone array calibration Adaboost adalaine adaptive exploration/exploitation trade-off adaptive learning rate adaptive resonance theory adaptive steepness Addressee estimation Adequacy of diffuseness Ad-hoc microphone array Adhoc microphone array calibration Ad-hoc microphone array calibration Ad-hoc microphone calibration AFC A...
Read more