I have csv containing 1.5 milion rows. I prepared Dataprep job that parse data and store them to BQ (or CSV). But after processing I have nearly half of rows missing (around 700k). When I run this Dataprep job without any recipe steps I got the same wrong number of rows.
I did analysis and data in input CSV looks correct. I filtered some subset of data that are missing in output and this small subset is imported correctly.
Isn't there something like sampling of data in output? What can cause my rows are lost.