{"id":7718,"date":"2024-11-14T12:13:44","date_gmt":"2024-11-14T04:13:44","guid":{"rendered":"https:\/\/fwq.ai\/blog\/7718\/"},"modified":"2024-11-14T12:13:44","modified_gmt":"2024-11-14T04:13:44","slug":"flink-cdc-%e7%9b%91%e5%90%ac-mysql-%e4%ba%8c%e8%bf%9b%e5%88%b6%e4%b8%bb%e9%94%ae%e6%97%b6%e5%87%ba%e7%8e%b0-classcastexception-%e5%a6%82%e4%bd%95%e8%a7%a3%e5%86%b3%ef%bc%9f","status":"publish","type":"post","link":"https:\/\/fwq.ai\/blog\/7718\/","title":{"rendered":"Flink CDC \u76d1\u542c MySQL \u4e8c\u8fdb\u5236\u4e3b\u952e\u65f6\u51fa\u73b0 ClassCastException \u5982\u4f55\u89e3\u51b3\uff1f"},"content":{"rendered":"<p><img decoding=\"async\" src=\"https:\/\/img.php.cn\/upload\/article\/001\/246\/273\/173119736278003.jpg\" class=\"aligncenter\" title=\"Flink CDC \u76d1\u542c MySQL \u4e8c\u8fdb\u5236\u4e3b\u952e\u65f6\u51fa\u73b0 ClassCastException \u5982\u4f55\u89e3\u51b3\uff1f\u63d2\u56fe\" alt=\"Flink CDC \u76d1\u542c MySQL \u4e8c\u8fdb\u5236\u4e3b\u952e\u65f6\u51fa\u73b0 ClassCastException \u5982\u4f55\u89e3\u51b3\uff1f\u63d2\u56fe\" \/><\/p>\n<p><strong>flink cdc \u76d1\u542c  binary \u4e3b\u952e\u65f6\u51fa\u73b0 classcastexception<\/strong><\/p>\n<p>\u4f7f\u7528 flink cdc \u76d1\u542c mysql \u65f6\uff0c\u5982\u679c mysql \u8868\u7684\u4e3b\u952e\u662f\u4e8c\u8fdb\u5236\u683c\u5f0f\uff0c\u53ef\u80fd\u4f1a\u9047\u5230\u4ee5\u4e0b\u9519\u8bef\uff1a<\/p>\n<pre>caused by: java.lang.classcastexception: [b cannot be cast to java.lang.comparable<\/pre>\n<p> \u767b\u5f55\u540e\u590d\u5236 <\/p>\n<p><strong>\u95ee\u9898\u5206\u6790<\/strong><\/p>\n<p>\u6b64\u9519\u8bef\u8868\u660e\u5728\u62c6\u8868\u65f6\u51fa\u73b0\u4e86\u95ee\u9898\u3002flink cdc \u5c06\u8868\u62c6\u5206\u4e3a\u66f4\u5c0f\u7684\u5206\u7247\uff0c\u7528\u4e8e\u5e76\u884c\u8bfb\u53d6\u3002\u62c6\u5206\u65f6\uff0cflink \u4f1a\u6bd4\u8f83\u4e3b\u952e\u503c\u4ee5\u786e\u5b9a\u5206\u7247\u7684\u8fb9\u754c\u3002\u4f46\u662f\uff0c\u5bf9\u4e8e\u4e8c\u8fdb\u5236\u683c\u5f0f\u7684\u4e3b\u952e\uff0c\u4e3b\u952e\u503c\u65e0\u6cd5\u76f4\u63a5\u8f6c\u6362\u4e3a\u53ef\u6bd4\u8f83\u7684\u5bf9\u8c61\uff0c\u56e0\u6b64\u4f1a\u51fa\u73b0 classcastexception\u3002<\/p>\n<p><strong>\u89e3\u51b3\u65b9\u6848<\/strong><\/p>\n<p>\u89e3\u51b3\u6b64\u95ee\u9898\u7684\u65b9\u6cd5\u662f\u5347\u7ea7\u5230 flink cdc 2.1.2 \u6216\u66f4\u9ad8\u7248\u672c\u3002\u5728\u8fd9\u4e9b\u7248\u672c\u4e2d\uff0c\u5df2\u7ecf\u4fee\u590d\u4e86\u8be5\u95ee\u9898\u3002\u6b64\u5916\uff0c\u8fd8\u53ef\u4ee5\u901a\u8fc7\u4ee5\u4e0b\u65b9\u5f0f\u89e3\u51b3\u95ee\u9898\uff1a<\/p>\n<ul>\n<li>\u5c06 mysql \u8868\u7684\u4e3b\u952e\u66f4\u6539\u4e3a\u975e\u4e8c\u8fdb\u5236\u683c\u5f0f\u3002<\/li>\n<li>\u4f7f\u7528 flink \u63d0\u4f9b\u7684 binaryprefixboundednessassigner \u6765\u5904\u7406\u4e8c\u8fdb\u5236\u4e3b\u952e\u3002<\/li>\n<\/ul>\n<p><strong>\u5177\u4f53\u6b65\u9aa4<\/strong><\/p>\n<p>\u5c06 flink cdc 2.1.1 \u5347\u7ea7\u5230 2.1.2 \u6216\u66f4\u9ad8\u7248\u672c\uff1a<\/p>\n<pre>mvn dependency:upgrade -dartifact org.apache.flink:flink-connector-mysql-cdc<\/pre>\n<p> \u767b\u5f55\u540e\u590d\u5236 <\/p>\n<p>\u4f7f\u7528 binaryprefixboundednessassigner \u6765\u5904\u7406\u4e8c\u8fdb\u5236\u4e3b\u952e\uff1a<\/p>\n<pre>ExecutionEnvironment env = ExecutionEnvironment.getExecutionEnvironment();\n\/\/ \u521b\u5efa MySQL source\nCDCSource&lt;Tuple5&lt;ByteString, ByteString, BigInteger, ByteString, Long&gt;&gt; source = CDCSource.&lt;Tuple5&lt;ByteString, ByteString, BigInteger, ByteString, Long&gt;&gt;builder()\n        .hostname(\"localhost\")\n        .port(3306)\n        .database(\"test_db\")\n        .tableList(\"test_table\")\n        .username(\"root\")\n        .password(\"root\")\n        \/\/ \u4f7f\u7528 BinaryPrefixBoundednessAssigner \u5904\u7406\u4e8c\u8fdb\u5236\u4e3b\u952e\n        .assigners(new BinaryPrefixBoundednessAssigner())\n        .build();<\/pre>\n<p> \u767b\u5f55\u540e\u590d\u5236 <\/p>\n<p>\u4ee5\u4e0a\u5c31\u662fFlink CDC \u76d1\u542c MySQL \u4e8c\u8fdb\u5236\u4e3b\u952e\u65f6\u51fa\u73b0 ClassCastException \u5982\u4f55\u89e3\u51b3\uff1f\u7684\u8be6\u7ec6\u5185\u5bb9\uff0c\u66f4\u591a\u8bf7\u5173\u6ce8\u7c73\u4e91\u7f51\u5176\u5b83\u76f8\u5173\u6587\u7ae0\uff01<\/p>\n","protected":false},"excerpt":{"rendered":"<p>flink cdc \u76d1\u542c binary \u4e3b\u952e\u65f6\u51fa\u73b0 classcastexception \u4f7f\u7528 flink cdc \u76d1\u542c mysql \u65f6\uff0c\u5982\u679c mysql \u8868\u7684\u4e3b\u952e\u662f\u4e8c\u8fdb\u5236\u683c\u5f0f\uff0c\u53ef\u80fd\u4f1a\u9047\u5230\u4ee5\u4e0b\u9519\u8bef\uff1a caused by: java.lang.classcastexception: [b cannot be cast to java.lang.comparable \u767b\u5f55\u540e\u590d\u5236 \u95ee\u9898\u5206\u6790 \u6b64\u9519\u8bef\u8868\u660e\u5728\u62c6\u8868\u65f6\u51fa\u73b0\u4e86\u95ee\u9898\u3002flink cdc \u5c06\u8868\u62c6\u5206\u4e3a\u66f4\u5c0f\u7684\u5206\u7247\uff0c\u7528\u4e8e\u5e76\u884c\u8bfb\u53d6\u3002\u62c6\u5206\u65f6\uff0cflink \u4f1a\u6bd4\u8f83\u4e3b\u952e\u503c\u4ee5\u786e\u5b9a\u5206\u7247\u7684\u8fb9\u754c\u3002\u4f46\u662f\uff0c\u5bf9\u4e8e\u4e8c\u8fdb\u5236\u683c\u5f0f\u7684\u4e3b\u952e\uff0c\u4e3b\u952e\u503c\u65e0\u6cd5\u76f4\u63a5\u8f6c\u6362\u4e3a\u53ef\u6bd4\u8f83\u7684\u5bf9\u8c61\uff0c\u56e0\u6b64\u4f1a\u51fa\u73b0 classcastexception\u3002 \u89e3\u51b3\u65b9\u6848 \u89e3\u51b3\u6b64\u95ee\u9898\u7684\u65b9\u6cd5\u662f\u5347\u7ea7\u5230 flink cdc 2.1.2 \u6216\u66f4\u9ad8\u7248\u672c\u3002\u5728\u8fd9\u4e9b\u7248\u672c\u4e2d\uff0c\u5df2\u7ecf\u4fee\u590d\u4e86\u8be5\u95ee\u9898\u3002\u6b64\u5916\uff0c\u8fd8\u53ef\u4ee5\u901a\u8fc7\u4ee5\u4e0b\u65b9\u5f0f\u89e3\u51b3\u95ee\u9898\uff1a \u5c06 mysql \u8868\u7684\u4e3b\u952e\u66f4\u6539\u4e3a\u975e\u4e8c\u8fdb\u5236\u683c\u5f0f\u3002 \u4f7f\u7528 flink \u63d0\u4f9b\u7684 binaryprefixboundednessassigner \u6765\u5904\u7406\u4e8c\u8fdb\u5236\u4e3b\u952e\u3002 \u5177\u4f53\u6b65\u9aa4 \u5c06 flink cdc 2.1.1 \u5347\u7ea7\u5230 2.1.2 \u6216\u66f4\u9ad8\u7248\u672c\uff1a mvn dependency:upgrade -dartifact [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[16],"tags":[],"class_list":["post-7718","post","type-post","status-publish","format-standard","hentry","category-16"],"_links":{"self":[{"href":"https:\/\/fwq.ai\/blog\/wp-json\/wp\/v2\/posts\/7718","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/fwq.ai\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/fwq.ai\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/fwq.ai\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/fwq.ai\/blog\/wp-json\/wp\/v2\/comments?post=7718"}],"version-history":[{"count":0,"href":"https:\/\/fwq.ai\/blog\/wp-json\/wp\/v2\/posts\/7718\/revisions"}],"wp:attachment":[{"href":"https:\/\/fwq.ai\/blog\/wp-json\/wp\/v2\/media?parent=7718"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/fwq.ai\/blog\/wp-json\/wp\/v2\/categories?post=7718"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/fwq.ai\/blog\/wp-json\/wp\/v2\/tags?post=7718"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}