[go: nahoru, domu]

MapReduce: Difference between revisions

Content deleted Content added
add Aurora ISA ref manual link
m v2.04b - Bot T20 CW#61 - Fix errors for CW project (Reference before punctuation)
Line 14:
MapReduce [[library (software)|libraries]] have been written in many programming languages, with different levels of optimization. A popular [[open-source software|open-source]] implementation that has support for distributed shuffles is part of [[Apache Hadoop]]. The name MapReduce originally referred to the proprietary [[Google]] technology, but has since been [[generic trademark|genericized]]. By 2014, Google was no longer using MapReduce as their primary ''[[big data]]'' processing model,<ref>{{cite web|url=http://www.datacenterknowledge.com/archives/2014/06/25/google-dumps-mapreduce-favor-new-hyper-scale-analytics-system/ | title=Google Dumps MapReduce in Favor of New Hyper-Scale Analytics System |last1=Sverdlik |first1=Yevgeniy |date=2014-06-25 |website=Data Center Knowledge |access-date=2015-10-25 |quote="We don't really use MapReduce anymore" [Urs Hölzle, senior vice president of technical infrastructure at Google]}}</ref> and development on [[Apache Mahout]] had moved on to more capable and less disk-oriented mechanisms that incorporated full map and reduce capabilities.<ref>{{cite web |url=https://gigaom.com/2014/03/27/apache-mahout-hadoops-original-machine-learning-project-is-moving-on-from-mapreduce/ |title=Apache Mahout, Hadoop's original machine learning project, is moving on from MapReduce |last1=Harris |first1=Derrick |date=2014-03-27 |website=[[Gigaom]] |access-date=2015-09-24 |quote=Apache Mahout [...] is joining the exodus away from MapReduce.}}</ref>
 
Interestingly, some [[Vector processors]] such as the [[NEC SX-Aurora TSUBASA]] have extensive mapreduce support built-in to their Vector instructions,<ref>[https://www.hpc.nec/documents/guide/pdfs/Aurora_ISA_guide.pdf NEC SX-Aurora ISA guide]</ref>, including in RISC-V Vectors<ref>[https://github.com/riscv/riscv-v-spec/blob/master/v-spec.adoc#vector-reduction-operations]</ref>
 
==Overview==