On
Abstract: Jflink On TiDB—Convenient and reliable real-time data service support, sharing outline as follows:
    JFlink real-time data business solution

  1. from a story of real-time accumulation of values

  3. Flink accurately guarantees that

  4. Flink with TiDB JFlink on TiDB

  5. real-time data service supports

What is JFlink?

Multiple built-in SDKs: Redis, ES, TiDB, HTTP, gRPC

Flink’s Checkpoint mechanism can ensure the Exact Once of data processing, and there will be a failure retry mechanism in the event of an abnormal failure, and the state can be restored, so as to ensure the accuracy of data processing.

End-to-end Exactly Once is guaranteed by 2PC (two-phase commit, see the TwoPhaseCommitSinkFunction class).

Not all sinks support the 2PC protocol

  • Real-time formatting of massive business log

    • data

  • is stored based on the analysis statistics of massive

  • dataReal-time payment link analysis of TiDB/Kafka dual-stream connection map time

  • series data

end

 

 

 
 public number (zhisheng)  reply to  Face, ClickHouse, ES, Flink, Spring, Java, Kafka, Monitoring < keywords such as span class="js_darkmode__148"> to view more articles corresponding to keywords. 
 
 
like + Looking, less bugs 👇