Record Linkage In Pyspark

Question

481 views Asked by Bidyasagar Pradhan At 22 February 2023 at 07:37

How to achieve recordlinkage functionality in Pyspark ??? I want to do a similarity check between Dataset1 Name and Dataset 2 Name.

Please help suggest me if any library available for pyspark.

I try with the recordlinkage library of pyhton but it is working with pandas dataframe.

There are 1 answers

**Nick Crews** · Answer 1 · 2023-02-26T17:23:40+00:00

Nick Crews On 26 February 2023 at 17:23

Splink is the best option that I know of.