BIG DATA for .NET Devs: HDInsight, Writing Hadoop Map Reduce Jobs In C# And Querying Results Back Using LINQ
Azure HD Insight Services is a 100% Apache Hadoop implementation on top of Microsoft Azure cloud ecosystem. In this post, we’ll explore HDInsight/Hadoop on Azure in general and steps for starting with the sameWriting Map Reduce Jobs for Hadoop using C# in particular to store results in HDFS. Transferring the result data from HDFS to Hive Reading the data back from the hive using C# and LINQPreface If you are new to Hadoop and Big Data concepts, I suggest you to quickly check outA quick introduction to HadoopA quick introduction to Map ReduceAn introduction to Hadoop HDInsight Services on AzureThere are a couple of ways you can start with HDInsight.You may Go to Azure Preview features and opt in for HDInsight and/or install the same locally Step 1: Setting up your instance locally in your WindowsFor Development, I highly recommend you to install HDInsight developer version locally – You can find it straight inside the Web Platform installer. Once you install the HDInsight locally, ens…