联系方式

  • QQ:99515681
  • 邮箱:99515681@qq.com
  • 工作时间:8:00-21:00
  • 微信:codinghelp

您当前位置:首页 >> Python编程Python编程

日期:2022-07-28 10:08

Lab 3: A Simple MapReduce-Style Wordcount Application

CMPSC 473, SUMMER 2022

Released on July 21, 2022, due on August 04, 2022, ll:59:59pm

Raj Pandey and Bhuvan Urgaonkar

1 Purpose and Background

This project is designed to give you experience in writing multi-threaded programs by

implementing a simplified MapReduce-style wordcount application. By working on this

project:

• You will learn to write multi-threaded code that correctly deals with race conditions.

• You will carry out a simple performance evaluation to examine the performance

impact of (i) the degree of parallelism in the mapper stage and (ii) the size of the

shared buffer which the two stages of your application will use to communicate.

Input

File

read

fappers Buffer

produce

Reducer

consume write

Output

File

Figure 1: Overview of our Mapreduce-style multi-threaded wordcount application.

The wordcount application takes as input a text file and produces as output the counts

for all uniquely occurring words in the input file arranged in an alphabetically increasing

order. We will assume that the words within our input files will only contain letters

of the English alphabet and the digits 0-9 (i.e., no punctuation marks or other special

characters). Our wordcount will consist of two stages. The first stage, called "mapper,"

1


版权所有:编程辅导网 2021 All Rights Reserved 联系方式:QQ:99515681 微信:codinghelp 电子信箱:99515681@qq.com
免责声明:本站部分内容从网络整理而来,只供参考!如有版权问题可联系本站删除。 站长地图

python代写
微信客服:codinghelp