Hi I have some CUDA memory issue even though I am using multiple GPUs. I am calling coreference resolution API on long document (aorund 2000words). It seems that the memory is not paralleled. How can I solve this issue? (I am currently using the API as here https://demo.allennlp.org/coreference-resolution)
CUDA memory issue with allennlp coreference resolution API
73 views Asked by Yijiang Dong At
1
There are 1 answers
Related Questions in ALLENNLP
- Being unabe to transfer an allen.nlp.Elmo model and character_ids on the same device
- Unable to install jsonnet in Google Colab notebook: failed building wheel
- Want to do coreference resolution. Can't install neuralcoref, allennlp and required version of spacy
- AttributeError by Allen NLP with pre trained Hugging face model
- Allennlp 2.10.1 Predictor throws "Not implemented" and "KeyError" Errors
- Unable to install spacy 2.1.9 on google colab with python 3.10
- Google Colab upgraded python version to 3.10
- Why the training time of CRF module from allennlp is higher?
- InvalidVersion: Invalid version: '0.10.1,<0.11' in Colab when trying to "from allennlp.nn.util import sort_batch_by_length, masked_softmax"
- How can I make the openIE input file format
- How to convert a list of words into multiple sentences in python
- How to install jsonnet on conda
- Load custom package model to get model vocabulary in AllenNLP python interface
- Change tokenizer when loading Dependency Parsing model from AllenNLP
- CUDA memory issue with allennlp coreference resolution API
Related Questions in COREFERENCE-RESOLUTION
- Changing a Noun to its Pronoun in a sentence
- Replace personal pronoun with previous person mentioned (noisy coref)
- Reference resolution in python
- Replace bidirectional LSTM with GRU in coref?
- Trying to train AllenNLP coreference resolution model on ontonotes: gets CUDA out of memory
- en_coref_lg model in spacy
- How to resolve coreferences without Internet using AllenNLP and coref-spanbert-large?
- Unable to install neuralcoref : Coreference Resolution in spaCy with Neural Networks
- What is the best way to handle Coreference Resolution in NLP
- SpaCy Coreferee: How to cleanly extract coreferenced text
- Which coreference chains does each sentence relate to in NeuralCoref?
- OOM issues with AllenNLP coreference resolution training and substituting models
- NLP: Resolve coreference pronoun in blocks
- AllenNLP predictor object loading before it is called -- rest of the script hangs
- Is there a way to change the tokenizer in AllenNLP's coreference resolution model?
Popular Questions
- How do I undo the most recent local commits in Git?
- How can I remove a specific item from an array in JavaScript?
- How do I delete a Git branch locally and remotely?
- Find all files containing a specific text (string) on Linux?
- How do I revert a Git repository to a previous commit?
- How do I create an HTML button that acts like a link?
- How do I check out a remote Git branch?
- How do I force "git pull" to overwrite local files?
- How do I list all files of a directory?
- How to check whether a string contains a substring in JavaScript?
- How do I redirect to another webpage?
- How can I iterate over rows in a Pandas DataFrame?
- How do I convert a String to an int in Java?
- Does Python have a string 'contains' substring method?
- How do I check if a string contains a specific word?
Popular Tags
Trending Questions
- UIImageView Frame Doesn't Reflect Constraints
- Is it possible to use adb commands to click on a view by finding its ID?
- How to create a new web character symbol recognizable by html/javascript?
- Why isn't my CSS3 animation smooth in Google Chrome (but very smooth on other browsers)?
- Heap Gives Page Fault
- Connect ffmpeg to Visual Studio 2008
- Both Object- and ValueAnimator jumps when Duration is set above API LvL 24
- How to avoid default initialization of objects in std::vector?
- second argument of the command line arguments in a format other than char** argv or char* argv[]
- How to improve efficiency of algorithm which generates next lexicographic permutation?
- Navigating to the another actvity app getting crash in android
- How to read the particular message format in android and store in sqlite database?
- Resetting inventory status after order is cancelled
- Efficiently compute powers of X in SSE/AVX
- Insert into an external database using ajax and php : POST 500 (Internal Server Error)
The coref model uses a lot of memory. It does not automatically take advantage of multiple GPUs. The best thing you can do is reduce the maximum sequence length you send to the model until it fits.