在运行数据流作业时,我得到了以下错误。我正在尝试将我现有的beam版本更新为2.11.0,但是在运行时,我会出现以下错误。
org.apache.beam.model.pipeline.v1.RunnerApi$StandardPTransforms$Primitives类没有实现请求的接口com.google.protobuf.ProtocolMessageEnum在org.apache.beam.runners.core.construction.BeamUrns.getUrn(BeamUrns.java:27) at org.apache.beam.runners.core.construction.PTransformTranslation.(PTransformTranslation.java:58) at org.apache.beam.runners.core.construction.UnconsumedReads$1.visitValue(UnconsumedReads.java:49) at org.apache。beam.sdk.runners.TransformHierarchy$Node.visit(TransformHierarchy.java:666) at org.apache.beam.sdk.runners.TransformHierarchy$Node.visit(TransformHierarchy.java:649) at org.apache.beam.sdk.runners.TransformHierarchy$Node.visit(TransformHierarchy.java:649) at org.apache.beam.sdk.runners.TransformHierarchy$Node.visit(TransformHierarchy.java:649) at org.apache.beam.sdk.runners.TransformHierarchy$Node.access$600(TransformHierarchy.java:311) at org.apache.beam.sdk.runners.TransformHierarchy.visit(TransformHierarchy.java:245) at org.apache.beam.sdk.Pipeline.traverseTopologically(Pipeline.java:458) at org.apache.beam.runners.core.construction.UnconsumedReads.ensureAllReadsConsumed(UnconsumedReads.java:40) at org.apache.beam.runners.dataflow.DataflowRunner.replaceTransforms(DataflowRunner.java:868) at org.apache.beam.runners.dataflow.DataflowRunner.run(DataflowRunner.java:660) at org.apache.beam.runners.dataflow.DataflowRunner.run(DataflowRunner.java:173) at org.apache.beam.sdk.Pipeline.run(Pipeline.java:313) at org.apache.beam.sdk.Pipeline.run(Pipeline.java:299)
发布于 2019-03-14 12:01:41
这通常意味着Beam所用的com.google.protobuf:protobuf-java
版本在运行时与版本不匹配。管道代码也依赖于协议缓冲区吗?
更新:我已经注册了https://issues.apache.org/jira/browse/BEAM-6839来跟踪这个。这是预料不到的。
发布于 2020-06-09 10:40:43
我没有足够的代表留下评论,但我遇到了这个问题,后来发现我的问题是,我的pom.xml有不同的波束版本。有的有2.19,有的有2.20。
我会在pom或gradle文件中快速搜索您的版本,以确保它们都是相同的。
发布于 2020-07-06 17:36:18
这可能是由于不兼容的依赖关系造成的。通过同时升级依赖项,我成功地将beam从2.2.0升级到2.20.0。
beam.version: 2.20.0
guava.version: 29.0-jre
bigquery.version: v2-rev20191211-1.30.9
google-api-client.version: 1.30.9
google-http-client.version: 1.34.0
pubsub.version: v1-rev20200312-1.30.9
https://stackoverflow.com/questions/55146663
复制相似问题