failure: Lost task 18.3 in stage 17.0 (TID 59784,XXXXX, executor 19): java.lang.IllegalArgumentException: Row length is 0
场景是写入hbase:
val put = new Put(Bytes.toBytes(line._1))
当取出的line._1做为row,值是“”或者null时就会出现此异常。所以做如下处理,先过滤掉为null和“”的数据
val bhaseRdd = resultRdd.filter(r => { r._1 != "" && r._1!=null&&r._1.length>0 }).map(line => { val put = new Put(Bytes.toBytes(line._1)) //rowKey 为参数,拿到put val key = line._2.keySet().iterator(); //拿到对应的dataMap ........
原文地址:https://www.cnblogs.com/shaozhiqi/p/11613605.html
时间: 2024-11-11 10:34:41