Actualización de un archivo HDFS de hadoop

I am a newbie to Hadoop. I have been reading that HDFS is mostly about "writing once, reading any times". I have a use case where I may have to make modifications to the files stored in HDFS. I have been researching if there are any ways of doing this.

My question is will it be possible to load the HDFS file into HBase, do the modifications, and save it back in HDFS, and deleting the original file. Please let me if this feasible.

preguntado el 01 de febrero de 12 a las 22:02

1 Respuestas

If you need to update values in a file you are much better of using HBase. You can still use your HBase table in your MR jobs via the TableInputFormat and TableOutputFormat. If you want to append data you can use any of the hadoop versions that support hdfs append such as 0.20.205.0.

Respondido 02 Feb 12, 03:02

Thanks Steve. Can I do randow writes in the hdfs file using hbase or is it only appends ? - Srini Subramanian

You can modify records in hbase randomly. - Steve Severance

Steve i have build a Hbase table able over a HDFS file. when i tried to update the Hbase records with simple 'Put' command im not able to see the changes in HDFS? Shouldn't it get auto updated? - Ragav

No es la respuesta que estás buscando? Examinar otras preguntas etiquetadas or haz tu propia pregunta.