https://www.thefinalartefact.xyz/tags/hive/Recent content in Hive on The Final ArtefactHugoen-gbFri, 13 Aug 2021 00:00:00 +0000https://www.thefinalartefact.xyz/post/importing-csv-to-hive/Fri, 13 Aug 2021 00:00:00 +0000https://www.thefinalartefact.xyz/post/importing-csv-to-hive/<h2 id="background">Background</h2> <p>Handling Hive/CSV interaction is a common reality of many analytical and data environments. The question on exporting data from Hive to CSV and other formats is frequently raised on online forums with answers frequently suggestring making use of <a href="https://en.wikipedia.org/wiki/Sed"><code>sed</code></a> that combined with nifty regular expressions pipes Hive output into a flat CSV files as an exporting solution. Import of large amounts of data is best handled by suitable tools like <a href="https://flume.apache.org">Apache Flume</a>. That is fine for simpler tables but may prove problematic for tables with a large amount of unstructured text. Frequently analysts and data scientists are faced with a challenge with storing data Hive on a irregular semi-regular basis. For instance, a job may produce new forecastring scenarios that we may want to make available through a Hive tables.</p>