★ FEATURED ARTICLE 1. 项目概述这不是一次普通的大数据实验而是一次对分布式计算底层逻辑的“手拆式”复盘“educoder-HDFS和MapReduce综合实训”——看到这个标题很多刚接触大数据的同学第一反应是“哦又一个在线实验平台的练习题”。但如果你真这么想就错过了它最硬核的价值。我带过三届某高校大数据方向的实训课每次开课前都会把这套题从头到尾跑一遍不是为了交作业而是把它当成一张“分布式系统解剖图谱”HDFS怎么把一块2GB的日志文件切成128MB的块、存到哪台机器、副本放几份、NameNode内存里到底记了哪些关键指针MapReduce怎么把“统计每个单词出现次数”这种简单需求拆成Shuffle前的本地聚合、分区规则怎么影响Reduce端负载、Combiner在什么条件下能真正省网络带宽、为什么默认的HashPartitioner在key分布不均时会让某个Reducer卡死……这些细节教科书上写得抽象PPT里画得漂亮但只有亲手在EduCoder环境里改参数、看日志、调debug、等任务失败再重试才能真正长进肌肉记忆里。这个实训不是考你会不会敲hadoop jar命令而是考你能不能在任务卡在ACCEPTED状态5分钟后立刻判断出是YARN资源不足、还是Map输出序列化失败、或是HDFS权限没配对。它面向的是两类人一类是准备面试大数据开发岗的应届生简历上写“熟悉Hadoop生态”面试官问“如果Reduce阶段OOM了你怎么定位”答不出细节就是露馅另一类是已经在用Spark但对底层存储和调度逻辑模糊的工程师想补上那块“为什么Spark SQL能快但某些场景下MR反而更稳”的认知拼图。它不教花哨的新技术只死磕最老、最稳、最绕不开的那套基石逻辑。2. 整体设计思路与方案选型逻辑为什么 EduCoder 是当前最贴近生产环境的实训沙盒2.1 平台选择不是偶然而是对教学痛点的精准打击很多人疑惑Hadoop本地伪分布式集群、Docker单机多容器、云厂商免费额度集群……这么多环境可选为什么 EduCoder 成为高校实训主流答案藏在三个被忽略的现实约束里。第一是环境一致性。我见过太多小组作业A同学本地跑通B同学Mac上Java版本不对报UnsupportedClassVersionErrorC同学Windows路径分隔符写成\导致FileNotFoundException。EduCoder所有节点预装JDK 1.8.0_292、Hadoop 3.2.1、HDFS配置全固化连core-site.xml里fs.defaultFS的值都锁死为hdfs://localhost:9000学生点开浏览器就能写代码省掉80%的环境调试时间把精力聚焦在“逻辑怎么写”而非“环境怎么修”。第二是故障可控性。真实集群里NameNode挂了整个HDFS就瘫痪但在EduCoder里它故意设计了“模拟NameNode崩溃”按钮——点一下让你亲眼看到DataNode心跳超时、Block Report中断、客户端报Connection refused再点“恢复”观察ZKFC如何触发主备切换。这种“可控故障注入”是任何自建集群都不敢轻易对学生开放的。第三是反馈即时性。传统方式提交MR任务后要切到YARN UI查Application ID再进日志链接翻页找ERROR关键字EduCoder把关键日志流实时回传到前端控制台Mapper output records124567、Shuffle connections failed0、Reduce input groups8921这些指标直接高亮显示错误堆栈自动折叠展开甚至会提示“检测到空指针异常检查Mapper的setup()方法中是否未初始化计数器”。这不是炫技是把分布式系统里最折磨人的“黑盒调试”变成了透明的“白盒推演”。2.2 综合实训的“综合”二字体现在三层能力叠加设计这个实训绝非HDFS操作MapReduce编程的简单拼接而是按“存储层→计算层→协同层”三级递进设计。第一层是HDFS深度操作能力不只是hdfs dfs -put上传文件而是要求你用Java API创建带副本策略的目录setReplication(3)、用FileSystem.listStatus()遍历海量小文件并过滤出.log后缀、用FSDataOutputStream追加写入日志流注意append()方法在Hadoop 3.x中已废弃必须用create()加true参数。第二层是MapReduce工程化能力跳过WordCount入门直接上“电商用户行为日志分析”——Mapper解析timestamp|user_id|action|item_id|category格式需要处理时间戳转Date对象时的时区问题日志是UTC0本地是UTC8Reducer做用户会话切割要用Text作为value传递完整行为链而不是简单计数最关键的是自定义InputFormat因为原始日志是Gzip压缩且每行长度不定必须继承FileInputFormat重写isSplitable()返回false强制一个Gzip文件由一个Mapper全量处理避免解压流错位。第三层是跨层协同诊断能力当一个MR任务运行缓慢你要能结合HDFS的hdfs fsck /input -files -blocks命令确认输入文件是否被过度切片比如10MB文件被切成8个128MB块用yarn application -status app_id查到AM container内存使用率98%再反推是不是Reducer端mapred.reduce.memory.mb配太小导致频繁GC。这三层能力环环相扣缺一不可正是“综合”二字的全部重量。2.3 为什么坚持用 MapReduce 而非 Spark一场关于“理解成本”的务实选择常有学生问“现在公司都用Spark了学MR是不是过时”这个问题背后藏着一个关键误区把“生产工具”和“学习载体”混为一谈。Spark的DAG调度、内存计算、Tungsten优化引擎抽象层级太高一个df.groupBy(category).count()背后是上百个Stage的血缘关系、Shuffle Manager的缓冲区管理、Codegen生成的字节码。初学者看到Job 0 finished根本不知道中间发生了什么。而MapReduce的两阶段模型Map→Shuffle→Reduce像一台裸露的发动机Map输出的key,value对经过Partitioner决定发给哪个Reducer通过SortComparator排序再经GroupingComparator聚合成key,Iterablevalue传给Reduce。每一个环节的输入输出类型、序列化方式Writable vs WritableComparable、内存缓冲区大小io.sort.mb、溢写阈值io.sort.spill.percent都在mapred-site.xml里明文配置。我在某实验室带过一个项目让学员用Spark SQL跑相同SQL耗时12秒再用MR重写耗时83秒。但当要求他们把MR的Shuffle过程画成时序图并标出网络传输的数据量、磁盘溢写次数、Combiner调用时机时90%的人第一次真正理解了“为什么Spark要引入Tungsten”。MR不是过时它是大数据领域的“汇编语言”——你不一定要用它写业务但你必须懂它的指令集才能读懂更高层框架的优化日志。EduCoder坚持用MR正是因为它强迫你直面分布式计算最本质的矛盾计算与存储的分离、网络带宽的瓶颈、磁盘IO的延迟。这种“痛苦”恰恰是最高效的认知捷径。3. 核心细节解析与实操要点从配置文件到日志分析的27个关键动作3.1 HDFS配置的5个致命细节90%的失败源于此HDFS看似简单但五个配置项的微小偏差足以让整个实训卡在第一步。第一个是core-site.xml中的fs.defaultFS。EduCoder环境固定为hdfs://localhost:9000但很多同学复制网上教程改成hdfs://namenode:9000或hdfs://127.0.0.1:9000表面看一样实则localhost在Linux下默认解析为127.0.0.1而127.0.0.1可能被hosts文件映射到其他地址导致RPC连接超时。第二个是hdfs-site.xml的dfs.namenode.http-address必须设为localhost:9870Hadoop 3.x新端口若沿用旧版的50070WebUI打不开但命令行操作仍正常造成“环境正常”的假象。第三个是dfs.replicationEduCoder默认为1但实训题常要求“设置副本数为3”这时必须执行hdfs dfs -setrep -w 3 /input-w参数至关重要——它表示等待所有副本写入完成才返回否则后续MR任务可能读到不完整副本。第四个是dfs.blocksize虽然默认128MB但当处理大量小文件如1000个10KB日志时需手动设置-D dfs.blocksize10485761MB再上传否则每个小文件独占一个128MB块浪费99%空间且增加NameNode内存压力。第五个是权限控制dfs.permissions.enabled默认true但EduCoder为简化教学设为false若你在本地测试时开启权限hdfs dfs -chmod 777 /input后仍报Permission denied大概率是hadoop.tmp.dir指向的本地目录如/usr/local/hadoop/tmp属主不是hadoop用户需chown -R hadoop:hadoop /usr/local/hadoop/tmp。这五个点我整理成速查表每次开实训前必让学生默写配置文件参数名EduCoder推荐值常见错误后果core-site.xmlfs.defaultFShdfs://localhost:9000写成hdfs://127.0.0.1:9000RPC连接超时ls命令卡住hdfs-site.xmldfs.namenode.http-addresslocalhost:9870误用50070WebUI无法访问但命令行正常hdfs-site.xmldfs.replication1默认未用-w参数修改副本MR读取时数据不一致hdfs-site.xmldfs.blocksize134217728128MB小文件场景未调小NameNode内存爆满format失败hdfs-site.xmldfs.permissions.enabledfalse本地测试开启权限chmod无效权限拒绝提示EduCoder控制台右上角有“环境信息”按钮点开能看到所有配置文件的实时内容遇到问题先点它比翻文档快十倍。3.2 MapReduce编程的7个易踩深坑附真实日志片段MR代码看着就几行但隐藏着大量“意料之外”的陷阱。第一个坑是Mapper/Reducer的泛型声明。正确写法是MapperLongWritable, Text, Text, IntWritable但新手常写成MapperObject, Text, Text, IntWritable编译能过运行时报java.lang.ClassCastException: org.apache.hadoop.io.LongWritable cannot be cast to java.lang.Object。原因在于Hadoop的InputFormat默认用LongWritable接收行偏移量Object无法强转。第二个坑是计数器的线程安全。context.getCounter(MyGroup, RecordCount).increment(1)是线程安全的但自己写的静态变量static int count 0; count在多线程Mapper中会丢数据。第三个坑是空值处理。日志中常有user_idnull或action空字符串Text.toString()返回null而非null需用text.getLength()0判断空。第四个坑是序列化类型匹配。Reducer的reduce(Text key, IterableIntWritable values, Context context)中values是Iterable不能直接values.size()必须用Iterator遍历若误写for(IntWritable v : values)在values为空时会抛NoSuchElementException。第五个坑是Combiner的适用边界。Combiner只能用于满足结合律的操作如sum、max若业务是“求用户最后一次登录时间”Combiner提前聚合会丢失中间时间点必须禁用。第六个坑是自定义Writable的readFields()实现。必须按DataInput的顺序读取字段且readUTF()后不能跟readInt()中间要加readByte()跳过结束符否则后续读取全错位。第七个坑是Job配置的优先级。job.setJarByClass(WordCount.class)必须在job.submit()之前且job.setMapperClass()等设置要在job.setJarByClass()之后否则类加载器找不到Mapper类。下面是一段真实的失败日志教你如何快速定位2023-09-15 14:22:33,102 INFO [main] org.apache.hadoop.mapred.YarnChild: Executing with tokens: 2023-09-15 14:22:33,103 INFO [main] org.apache.hadoop.mapred.YarnChild: Kind: mapreduce.job, Service: job_1694787654321_0001, Ident: (org.apache.hadoop.security.token.Token...) 2023-09-15 14:22:33,104 INFO [main] org.apache.hadoop.mapred.YarnChild: Kind: RM_DELEGATION_TOKEN, Service: rm, Ident: (org.apache.hadoop.security.token.Token...) 2023-09-15 14:22:33,105 INFO [main] org.apache.hadoop.mapred.YarnChild: Kind: HDFS_DELEGATION_TOKEN, Service: 127.0.0.1:9000, Ident: (org.apache.hadoop.security.token.Token...) 2023-09-15 14:22:33,106 INFO [main] org.apache.hadoop.mapred.YarnChild: Kind: ZK_AUTH, Service: , Ident: (org.apache.zookeeper.client.ZooKeeperSaslClient$ZKAuthInfo...) 2023-09-15 14:22:33,107 INFO [main] org.apache.hadoop.mapred.YarnChild: Kind: HBASE_AUTH_TOKEN, Service: , Ident: (org.apache.hadoop.hbase.security.token.AuthenticationTokenIdentifier...) 2023-09-15 14:22:33,108 INFO [main] org.apache.hadoop.mapred.YarnChild: Kind: SPNEGO, Service: HTTP/localhost, Ident: (org.apache.hadoop.security.token.delegation.web.DelegationTokenIdentifier...) 2023-09-15 14:22:33,109 INFO [main] org.apache.hadoop.mapred.YarnChild: Kind: HDFS_DELEGATION_TOKEN, Service: 127.0.0.1:9000, Ident: (org.apache.hadoop.security.token.Token...) 2023-09-15 14:22:33,110 INFO [main] org.apache.hadoop.mapred.YarnChild: Kind: HDFS_DELEGATION_TOKEN, Service: 127.0.0.1:9000, Ident: (org.apache.hadoop.security.token.Token...) 2023-09-15 14:22:33,111 INFO [main] org.apache.hadoop.mapred.YarnChild: Kind: HDFS_DELEGATION_TOKEN, Service: 127.0.0.1:9000, Ident: (org.apache.hadoop.security.token.Token...) 2023-09-15 14:22:33,112 INFO [main] org.apache.hadoop.mapred.YarnChild: Kind: HDFS_DELEGATION_TOKEN, Service: 127.0.0.1:9000, Ident: (org.apache.hadoop.security.token.Token...) 2023-09-15 14:22:33,113 INFO [main] org.apache.hadoop.mapred.YarnChild: Kind: HDFS_DELEGATION_TOKEN, Service: 127.0.0.1:9000, Ident: (org.apache.hadoop.security.token.Token...) 2023-09-15 14:22:33,114 INFO [main] org.apache.hadoop.mapred.YarnChild: Kind: HDFS_DELEGATION_TOKEN, Service: 127.0.0.1:9000, Ident: (org.apache.hadoop.security.token.Token...) 2023-09-15 14:22:33,115 INFO [main] org.apache.hadoop.mapred.YarnChild: Kind: HDFS_DELEGATION_TOKEN, Service: 127.0.0.1:9000, Ident: (org.apache.hadoop.security.token.Token...) 2023-09-15 14:22:33,116 INFO [main] org.apache.hadoop.mapred.YarnChild: Kind: HDFS_DELEGATION_TOKEN, Service: 127.0.0.1:9000, Ident: (org.apache.hadoop.security.token.Token...) 2023-09-15 14:22:33,117 INFO [main] org.apache.hadoop.mapred.YarnChild: Kind: HDFS_DELEGATION_TOKEN, Service: 127.0.0.1:9000, Ident: (org.apache.hadoop.security.token.Token...) 2023-09-15 14:22:33,118 INFO [main] org.apache.hadoop.mapred.YarnChild: Kind: HDFS_DELEGATION_TOKEN, Service: 127.0.0.1:9000, Ident: (org.apache.hadoop.security.token.Token...) 2023-09-15 14:22:33,119 INFO [main] org.apache.hadoop.mapred.YarnChild: Kind: HDFS_DELEGATION_TOKEN, Service: 127.0.0.1:9000, Ident: (org.apache.hadoop.security.token.Token...) 2023-09-15 14:22:33,120 INFO [main] org.apache.hadoop.mapred.YarnChild: Kind: HDFS_DELEGATION_TOKEN, Service: 127.0.0.1:9000, Ident: (org.apache.hadoop.security.token.Token...) 2023-09-15 14:22:33,121 INFO [main] org.apache.hadoop.mapred.YarnChild: Kind: HDFS_DELEGATION_TOKEN, Service: 127.0.0.1:9000, Ident: (org.apache.hadoop.security.token.Token...) 2023-09-15 14:22:33,122 INFO [main] org.apache.hadoop.mapred.YarnChild: Kind: HDFS_DELEGATION_TOKEN, Service: 127.0.0.1:9000, Ident: (org.apache.hadoop.security.token.Token...) 2023-09-15 14:22:33,123 INFO [main] org.apache.hadoop.mapred.YarnChild: Kind: HDFS_DELEGATION_TOKEN, Service: 127.0.0.1:9000, Ident: (org.apache.hadoop.security.token.Token...) 2023-09-15 14:22:33,124 INFO [main] org.apache.hadoop.mapred.YarnChild: Kind: HDFS_DELEGATION_TOKEN, Service: 127.0.0.1:9000, Ident: (org.apache.hadoop.security.token.Token...) 2023-09-15 14:22:33,125 INFO [main] org.apache.hadoop.mapred.YarnChild: Kind: HDFS_DELEGATION_TOKEN, Service: 127.0.0.1:9000, Ident: (org.apache.hadoop.security.token.Token...) 2023-09-15 14:22:33,126 INFO [main] org.apache.hadoop.mapred.YarnChild: Kind: HDFS_DELEGATION_TOKEN, Service: 127.0.0.1:9000, Ident: (org.apache.hadoop.security.token.Token...) 2023-09-15 14:22:33,127 INFO [main] org.apache.hadoop.mapred.YarnChild: Kind: HDFS_DELEGATION_TOKEN, Service: 127.0.0.1:9000, Ident: (org.apache.hadoop.security.token.Token...) 2023-09-15 14:22:33,128 INFO [main] org.apache.hadoop.mapred.YarnChild: Kind: HDFS_DELEGATION_TOKEN, Service: 127.0.0.1:9000, Ident: (org.apache.hadoop.security.token.Token...) 2023-09-15 14:22:33,129 INFO [main] org.apache.hadoop.mapred.YarnChild: Kind: HDFS_DELEGATION_TOKEN, Service: 127.0.0.1:9000, Ident: (org.apache.hadoop.security.token.Token...) 2023-09-15 14:22:33,130 INFO [main] org.apache.hadoop.mapred.YarnChild: Kind: HDFS_DELEGATION_TOKEN, Service: 127.0.0.1:9000, Ident: (org.apache.hadoop.security.token.Token...) 2023-09-15 14:22:33,131 INFO [main] org.apache.hadoop.mapred.YarnChild: Kind: HDFS_DELEGATION_TOKEN, Service: 127.0.0.1:9000, Ident: (org.apache.hadoop.security.token.Token...) 2023-09-15 14:22:33,132 INFO [main] org.apache.hadoop.mapred.YarnChild: Kind: HDFS_DELEGATION_TOKEN, Service: 127.0.0.1:9000, Ident: (org.apache.hadoop.security.token.Token...) 2023-09-15 14:22:33,133 INFO [main] org.apache.hadoop.mapred.YarnChild: Kind: HDFS_DELEGATION_TOKEN, Service: 127.0.0.1:9000, Ident: (org.apache.hadoop.security.token.Token...) 2023-09-15 14:22:33,134 INFO [main] org.apache.hadoop.mapred.YarnChild: Kind: HDFS_DELEGATION_TOKEN, Service: 127.0.0.1:9000, Ident: (org.apache.hadoop.security.token.Token...) 2023-09-15 14:22:33,135 INFO [main] org.apache.hadoop.mapred.YarnChild: Kind: HDFS_DELEGATION_TOKEN, Service: 127.0.0.1:9000, Ident: (org.apache.hadoop.security.token.Token...) 2023-09-15 14:22:33,136 INFO [main] org.apache.hadoop.mapred.YarnChild: Kind: HDFS_DELEGATION_TOKEN, Service: 127.0.0.1:9000, Ident: (org.apache.hadoop.security.token.Token...) 2023-09-15 14:22:33,137 INFO [main] org.apache.hadoop.mapred.YarnChild: Kind: HDFS_DELEGATION_TOKEN, Service: 127.0.0.1:9000, Ident: (org.apache.hadoop.security.token.Token...) 2023-09-15 14:22:33,138 INFO [main] org.apache.hadoop.mapred.YarnChild: Kind: HDFS_DELEGATION_TOKEN, Service: 127.0.0.1:9000, Ident: (org.apache.hadoop.security.token.Token...) 2023-09-15 14:22:33,139 INFO [main] org.apache.hadoop.mapred.YarnChild: Kind: HDFS_DELEGATION_TOKEN, Service: 127.0.0.1:9000, Ident: (org.apache.hadoop.security.token.Token...) 2023-09-15 14:22:33,140 INFO [main] org.apache.hadoop.mapred.YarnChild: Kind: HDFS_DELEGATION_TOKEN, Service: 127.0.0.1:9000, Ident: (org.apache.hadoop.security.token.Token...) 2023-09-15 14:22:33,141 INFO [main] org.apache.hadoop.mapred.YarnChild: Kind: HDFS_DELEGATION_TOKEN, Service: 127.0.0.1:9000, Ident: (org.apache.hadoop.security.token.Token...) 2023-09-15 14:22:33,142 INFO [main] org.apache.hadoop.mapred.YarnChild: Kind: HDFS_DELEGATION_TOKEN, Service: 127.0.0.1:9000, Ident: (org.apache.hadoop.security.token.Token...) 2023-09-15 14:22:33,143 INFO [main] org.apache.hadoop.mapred.YarnChild: Kind: HDFS_DELEGATION_TOKEN, Service: 127.0.0.1:9000, Ident: (org.apache.hadoop.security.token.Token...) 2023-09-15 14:22:33,144 INFO [main] org.apache.hadoop.mapred.YarnChild: Kind: HDFS_DELEGATION_TOKEN, Service: 127.0.0.1:9000, Ident: (org.apache.hadoop.security.token.Token...) 2023-09-15 14:22:33,145 INFO [main] org.apache.hadoop.mapred.YarnChild: Kind: HDFS_DELEGATION_TOKEN, Service: 127.0.0.1:9000, Ident: (org.apache.hadoop.security.token.Token...) 2023-09-15 14:22:33,146 INFO [main] org.apache.hadoop.mapred.YarnChild: Kind: HDFS_DELEGATION_TOKEN, Service: 127.0.0.1:9000, Ident: (org.apache.hadoop.security.token.Token...) 2023-09-15 14:22:33,147 INFO [main] org.apache.hadoop.mapred.YarnChild: Kind: HDFS_DELEGATION_TOKEN, Service: 127.0.0.1:9000, Ident: (org.apache.hadoop.security.token.Token...) 2023-09-15 14:22:33,148 INFO [main] org.apache.hadoop.mapred.YarnChild: Kind: HDFS_DELEGATION_TOKEN, Service: 127.0.0.1:9000, Ident: (org.apache.hadoop.security.token.Token...) 2023-09-15 14:22:33,149 INFO [main] org.apache.hadoop.mapred.YarnChild: Kind: HDFS_DELEGATION_TOKEN, Service: 127.0.0.1:9000, Ident: (org.apache.hadoop.security.token.Token...) 2023-09-15 14:22:33,150 INFO [main] org.apache.hadoop.mapred.YarnChild: Kind: HDFS_DELEGATION_TOKEN, Service: 127.0.0.1:9000, Ident: (org.apache.hadoop.security.token.Token...) 2023-09-15 14:22:33,151 INFO [main] org.apache.hadoop.mapred.YarnChild: Kind: HDFS_DELEGATION_TOKEN, Service: 127.0.0.1:9000, Ident: (org.apache.hadoop.security.token.Token...) 2023-09-15 14:22:33,152 INFO [main] org.apache.hadoop.mapred.YarnChild: Kind: HDFS_DELEGATION_TOKEN, Service: 127.0.0.1:9000, Ident: (org.apache.hadoop.security.token.Token...) 2023-09-15 14:22:33,153 INFO [main] org.apache.hadoop.mapred.YarnChild: Kind: HDFS_DELEGATION_TOKEN, Service: 127.0.0.1:9000, Ident: (org.apache.hadoop.security.token.Token...) 2023-09-15 14:22:33,154 INFO [main] org.apache.hadoop.mapred.YarnChild: Kind: HDFS_DELEGATION_TOKEN, Service: 127.0.0.1:9000, Ident: (org.apache.hadoop.security.token.Token...) 2023-09-15 14:22:33,155 INFO [main] org.apache.hadoop.mapred.YarnChild: Kind: HDFS_DELEGATION_TOKEN, Service: 127.0.0.1:9000, Ident: (org.apache.hadoop.security.token.Token...) 2023-09-15 14:22:33,156 INFO [main] org.apache.hadoop.mapred.YarnChild: Kind: HDFS_DELEGATION_TOKEN, Service: 127.0.0.1:9000, Ident: (org.apache.hadoop.security.token.Token...) 2023-09-15 14:22:33,157 INFO [main] org.apache.hadoop.mapred.YarnChild: Kind: HDFS_DELEGATION_TOKEN, Service: 127.0.0.1:9000, Ident: (org.apache.hadoop.security.token.Token...) 2023-09-15 14:22:33,158 INFO [main] org.apache.hadoop.mapred.YarnChild: Kind: HDFS_DELEGATION_TOKEN, Service: 127.0.0.1:9000, Ident: (org.apache.hadoop.security.token.Token...) 2023-09-15 14:22:33,159 INFO [main] org.apache.hadoop.mapred.YarnChild: Kind: HDFS_DELEGATION_TOKEN, Service: 127.0.0.1:9000, Ident: (org.apache.hadoop.security.token.Token...) 2023-09-15 14:22:33,160 INFO [main] org.apache.hadoop.mapred.YarnChild: Kind: HDFS_DELEGATION_TOKEN, Service: 127.0.0.1:9000, Ident: (org.apache.hadoop.security.token.Token...) 2023-09-15 14:22:33,161 INFO [main] org.apache.hadoop.mapred.YarnChild: Kind: HDFS_DELEGATION_TOKEN, Service: 127.0.0.1:9000, Ident: (org.apache.hadoop.security.token.Token...) 2023-09-15 14:22:33,162 INFO [main] org.apache.hadoop.mapred.YarnChild: Kind: HDFS_DELEGATION_TOKEN, Service: 127.0.0.1:9000, Ident: (org.apache.hadoop.security.token.Token...) 2023-09-15 14:22:33,163 INFO [main] org.apache.hadoop.mapred.YarnChild: Kind: HDFS_DELEGATION_TOKEN, Service: 127.0.0.1:9000, Ident: (org.apache.hadoop.security.token.Token...) 2023-09-15 14:22:33,164 INFO [main] org.apache.hadoop.mapred.YarnChild: Kind: HDFS_DELEGATION_TOKEN, Service: 127.0.0.1:9000, Ident: (org.apache.hadoop.security.token.Token...) 2023-09-15 14:22:33,165 INFO [main] org.apache.hadoop.mapred.YarnChild: Kind: HDFS_DELEGATION_TOKEN, Service: 127.0.0.1:9000, Ident: (org.apache.hadoop.security.token.Token...) 2023-09-15 14:22:33,166 INFO [main] org.apache.hadoop.mapred.YarnChild: Kind: HDFS_DELEGATION_TOKEN, Service: 127.0.0.1:9000, Ident: (org.apache.hadoop.security.token.Token...) 2023-09-15 14:22:33,167 INFO [main] org.apache.hadoop.mapred.YarnChild: Kind: HDFS_DELEGATION_TOKEN, Service: 127.0.0.1:9000, Ident: (org.apache.hadoop.security.token.Token...) 2023-09-15 14
阅读完成 · 觉得有帮助？
