I am responsible for designing an API that must return a large amount of data (around 4,500,000 given rows for 41 fields each). We decided to use Spring Webflux and R2DBC since it is a Mariadb database. The problem we have is weblux waits for the entire result of the query before loading the data in the form of a stream, and given the size of the data to load we end up with a long wait and a "Java Heap Space" type error . It seems to me that the very principle of webflux is to send data as and when it is available, so why this behavior? Even when the sql query is of type "Select COUNT" it is the same. Does anyone have a solution for me other than pagination?
Out of memory error when loading large dataset with webflux
99 views Asked by Aristide Etoumi At
0
There are 0 answers
Related Questions in SPRING-BOOT
- Multi Tenancy in Spring - Partitioned Data Approach
- I have created a spring boot application with spring data JPA, Rest ,oracle and i am getting this ORA-00933: SQL command not properly ended
- Springboot: How to get an entity optional property and check null?
- How to create jasper report in spring boot rest api with jpa
- JSON Body is Not Passing Certain Strings
- Unresolved reference error is showing up after adding the dgs codegen plugin successfully
- Transaction silently rolled back
- JPA buddy error when generating JPA Entities from DB
- Migrating Spring Boot 2 to 3 throws org.glassfish.jaxb.runtime.v2.runtime.IllegalAnnotationsException: 3 counts of IllegalAnnotationExceptions
- Hibernate SQL Error: Missing FROM-clause entry for table "th1_1"
- Appwrite and / or Spring Boot Backend
- Failed to configure a DataSource: 'url' attribute is not specified and no embedded datasource could be configured. I'm using Postgresql
- Driver com.microsoft.sqlserver.jdbc.SQLServerDriver claims to not accept jdbcUrl, ${SPRING_DATASOURCE_URL}: GitHub Actions
- springboot class org.hibernate.mapping.Bag cannot be cast to class org.hibernate.mapping.SimpleValue
- Spring security causing 404 with message "No static resource login"
Related Questions in SPRING-WEBFLUX
- How do you retrieve body from ClientResponse?
- WebClient apears to add headers to request on its own. Where does it happen?
- How to build a reactive application using React Query and Spring Webflux
- How can I make asserts on outbound HTTP requests?
- Spring Security Reactive OAuth2 Client: Options for Customizing Refresh Endpoint
- Spring ReactiveMongoRepository function with nested reactive operations timing out
- how to avoid handling `AbortedException` with Spring WebFlux while handling for generic Exceptions?
- Default /logout does not work if /login is customised spring security 5.7.11
- CompletableFuture: thenAccept called but whenComplete is not
- WebFlux is unable to decode Chunked requests properly
- getting error for Macbook Air M1 "Unable to load io.netty.resolver.dns.macos.MacOSDnsServerAddressStreamProvider, fallback to system defaults
- For Spring Boot Webclient, what is the preferred mechanism to log non-parseable responses?
- Should I use concatMap in reactive for DB call?
- Create webclient object based on changes in BaseURL & scope
- Reactive Spring Security is always creating the Session in redis even when NoOpServerSecurityContextRepository specified for securityContextRepository
Related Questions in R2DBC
- String refernce is held in heap after sql execution
- How to view the implementation of CoroutineCrudRepository automatically generated by Spring R2DBC?
- jOOQ select Master-Details filter by details's property
- How to process flux in batches and have each batch processed in parallel
- r2dbc-pool: Using the r2dbc connection pool slows down the execution of parallel transactions
- POST with autogenerated id in r2dbc
- How to test SELECT FOR UPDATE with R2DBC postgresql and Webflux
- R2DBC - Is there a way to use two different database clients when using a CrudRepository?
- R2DBC Core DatabaseClient.sql replacing column 'key' to '[*]key'
- Can't set the List<...> parameter in the query
- Spring data R2DBC Custom query builder
- Spring webflux - How to use rsql queries inside a spring reactive app using R2DBC?
- Spring r2dbc jOOQ transaction rollback not working
- Difference between Spring R2DBC using EntityCallbacks vs Mapping and use case?
- Can I use Quarkus Reactive Panache with Oracle R2DBC? Are they compatible?
Related Questions in R2DBC-MYSQL
- Spring Project Reactor: Reactive Netty DNS resolver issue
- Out of memory error when loading large dataset with webflux
- Spring Data R2DBC - MySQL Stored procedure execution
- r2dbc-pool can do validationInterval?
- When returning a Flux of type T from a controller it returns an incomplete list
- Slice/Page method return Reference in R2DBC is invalid?
- Webflux and R2dbc-mysql demo, run failed
- SpringBoot 3 Webflux R2DBC MySQL Timezone issue
- Getting "Access Denied for user (using password: YES ) " while using AWS RDS IAM based authentication for R2DBC
- @Transactional with r2dbc-mysql of dev.miku not working
- how to configurate r2dbc with yaml?
- how to insert multi values into one column?
- java.lang.Integer cannot be cast to class java.lang.Long in R2DBC mysql model classes
- How to use lock in R2DBC correctly?
- Spring boot upgrade from 2.6.6 to 2.7.1 - dev.miku:r2dbc-mysql
Popular Questions
- How do I undo the most recent local commits in Git?
- How can I remove a specific item from an array in JavaScript?
- How do I delete a Git branch locally and remotely?
- Find all files containing a specific text (string) on Linux?
- How do I revert a Git repository to a previous commit?
- How do I create an HTML button that acts like a link?
- How do I check out a remote Git branch?
- How do I force "git pull" to overwrite local files?
- How do I list all files of a directory?
- How to check whether a string contains a substring in JavaScript?
- How do I redirect to another webpage?
- How can I iterate over rows in a Pandas DataFrame?
- How do I convert a String to an int in Java?
- Does Python have a string 'contains' substring method?
- How do I check if a string contains a specific word?
Popular Tags
Trending Questions
- UIImageView Frame Doesn't Reflect Constraints
- Is it possible to use adb commands to click on a view by finding its ID?
- How to create a new web character symbol recognizable by html/javascript?
- Why isn't my CSS3 animation smooth in Google Chrome (but very smooth on other browsers)?
- Heap Gives Page Fault
- Connect ffmpeg to Visual Studio 2008
- Both Object- and ValueAnimator jumps when Duration is set above API LvL 24
- How to avoid default initialization of objects in std::vector?
- second argument of the command line arguments in a format other than char** argv or char* argv[]
- How to improve efficiency of algorithm which generates next lexicographic permutation?
- Navigating to the another actvity app getting crash in android
- How to read the particular message format in android and store in sqlite database?
- Resetting inventory status after order is cancelled
- Efficiently compute powers of X in SSE/AVX
- Insert into an external database using ajax and php : POST 500 (Internal Server Error)