{"id":6880,"date":"2013-12-23T10:32:29","date_gmt":"2013-12-23T10:32:29","guid":{"rendered":"http:\/\/mcslp.wordpress.com\/?p=9973"},"modified":"2013-12-23T10:32:29","modified_gmt":"2013-12-23T10:32:29","slug":"sql-to-hadoop-and-back-again-part-3-direct-transfer-and-live-data-exchange","status":"publish","type":"post","link":"https:\/\/planet.mcb.guru\/?p=6880","title":{"rendered":"SQL to Hadoop and back again, Part 3: Direct transfer and live data exchange"},"content":{"rendered":"<p>The third, and final article in my series on migrating data to and from Hadoop and SQL databases is now available:<\/p>\n<blockquote><p><span style=\"color:#333333;font-family:HelveticaNeue-Light, 'Helvetica Neue Light', 'Helvetica Neue', Helvetica, Arial;font-size:15px;font-style:normal;line-height:19px;background-color:#f9f9f9;\">Big data is a term that has been used regularly now for almost a decade, and it \u2014 along with technologies like NoSQL \u2014 are seen as the replacements for the long-successful RDBMS solutions that use SQL. Today, DB2\u00ae, Oracle, Microsoft\u00ae SQL Server MySQL, and PostgreSQL dominate the SQL space and still make up a considerable proportion of the overall market. In this final article of the series, we will look at more automated solutions for migrating data to and from Hadoop. In the previous articles, we concentrated on methods that take exports or otherwise formatted and extracted data from your SQL source, load that into Hadoop in some way, then process or parse it. But if you want to analyze big data, you probably don&#8217;t want to wait while exporting the data. Here, we&#8217;re going to look at some methods and tools that enable a live transfer of data between your SQL and Hadoop environments.<\/span><\/p>\n<\/blockquote>\n<p><a href=\"http:\/\/www.ibm.com\/developerworks\/library\/bd-sqltohadoop3\/\">SQL to Hadoop and back again, Part 3: Direct transfer and live data exchange<\/a>.<\/p><br \/>  <a rel=\"nofollow\" href=\"http:\/\/feeds.wordpress.com\/1.0\/gocomments\/mcslp.wordpress.com\/9973\/\"><img alt=\"\" border=\"0\" src=\"http:\/\/feeds.wordpress.com\/1.0\/comments\/mcslp.wordpress.com\/9973\/\" \/><\/a> <img alt=\"\" border=\"0\" src=\"http:\/\/stats.wordpress.com\/b.gif?host=mcslp.wordpress.com&#038;blog=164882&%23038;post=9973&%23038;subd=mcslp&%23038;ref=&%23038;feed=1\" width=\"1\" height=\"1\" \/>","protected":false},"excerpt":{"rendered":"<p>The third, and final article in my series on migrating data to and from Hadoop and SQL databases is now available: Big data is a term that has been used regularly now for almost a decade, and it &mdash; along &hellip; <a href=\"http:\/\/mcslp.wordpress.com\/2013\/12\/23\/sql-to-hadoop-and-back-again-part-3-direct-transfer-and-live-data-exchange\/\">Continue reading <span>&rarr;<\/span><\/a><img loading=\"lazy\" decoding=\"async\" alt=\"\" border=\"0\" src=\"http:\/\/stats.wordpress.com\/b.gif?host=mcslp.wordpress.com&amp;blog=164882&amp;post=9973&amp;subd=mcslp&amp;ref=&amp;feed=1\" width=\"1\" height=\"1\"\/><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[86,76,75],"tags":[42,57],"_links":{"self":[{"href":"https:\/\/planet.mcb.guru\/index.php?rest_route=\/wp\/v2\/posts\/6880"}],"collection":[{"href":"https:\/\/planet.mcb.guru\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/planet.mcb.guru\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/planet.mcb.guru\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/planet.mcb.guru\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=6880"}],"version-history":[{"count":1,"href":"https:\/\/planet.mcb.guru\/index.php?rest_route=\/wp\/v2\/posts\/6880\/revisions"}],"predecessor-version":[{"id":6901,"href":"https:\/\/planet.mcb.guru\/index.php?rest_route=\/wp\/v2\/posts\/6880\/revisions\/6901"}],"wp:attachment":[{"href":"https:\/\/planet.mcb.guru\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=6880"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/planet.mcb.guru\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=6880"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/planet.mcb.guru\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=6880"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}