I'm stuck in sentiment analysis and I found Vader solution which is the best I could find so far. My issue is that I don't find any doc on how to feed it with languages other than English.
Is Vader SentimentIntensityAnalyzer Multilingual?
16k views Asked by Curcuma_ At
2
There are 2 answers
1
FrancoSwiss
On
I tried NLTK Vader in another language. It works fairly well with German - after all, the languages are not too far from each other.
There is some work involved - we can't just translate the lexicon:
- Change the vader_lexicon.txt
- Change the NEGATE words in the code
- Change the BOOSTER words in the code
- Change SPECIAL_CASE_IDIOMS in the code
In general, negations work, but there are cases which involve some additional work which I haven't figured out yet.
Related Questions in PYTHON
- How to store a date/time in sqlite (or something similar to a date)
- Instagrapi recently showing HTTPError and UnknownError
- How to Retrieve Data from an MySQL Database and Display it in a GUI?
- How to create a regular expression to partition a string that terminates in either ": 45" or ",", without the ": "
- Python Geopandas unable to convert latitude longitude to points
- Influence of Unused FFN on Model Accuracy in PyTorch
- Seeking Python Libraries for Removing Extraneous Characters and Spaces in Text
- Writes to child subprocess.Popen.stdin don't work from within process group?
- Conda has two different python binarys (python and python3) with the same version for a single environment. Why?
- Problem with add new attribute in table with BOTO3 on python
- Can't install packages in python conda environment
- Setting diagonal of a matrix to zero
- List of numbers converted to list of strings to iterate over it. But receiving TypeError messages
- Basic Python Question: Shortening If Statements
- Python and regex, can't understand why some words are left out of the match
Related Questions in MACHINE-LEARNING
- Trained ML model with the camera module is not giving predictions
- Keras similarity calculation. Enumerating distance between two tensors, which indicates as lists
- How to get content of BLOCK types LAYOUT_TITLE, LAYOUT_SECTION_HEADER and LAYOUT_xx in Textract
- How to predict input parameters from target parameter in a machine learning model?
- The training accuracy and the validation accuracy curves are almost parallel to each other. Is the model overfitting?
- ImportError: cannot import name 'HuggingFaceInferenceAPI' from 'llama_index.llms' (unknown location)
- Which library can replace causal_conv1d in machine learning programming?
- Fine-Tuning Large Language Model on PDFs containing Text and Images
- Sketch Guided Text to Image Generation
- My ICNN doesn't seem to work for any n_hidden
- Optuna Hyperband Algorithm Not Following Expected Model Training Scheme
- How can I resolve this error and work smoothly in deep learning?
- ModuleNotFoundError: No module named 'llama_index.node_parser'
- Difference between model.evaluate and metrics.accuracy_score
- Give Bert an input and ask him to predict. In this input, can Bert apply the first word prediction result to all subsequent predictions?
Related Questions in SENTIMENT-ANALYSIS
- How to do sentiment analysis in R of multiple annual reports which is in pdf format? Please provide the code as I am a beginner
- How can i get the first content of a python synsets list?
- SpaCy Sentiment Analysis: Non-blank NLP model raises error during training update
- Issue Accessing .bin Files in React Native App
- How to save all of the recently recorded real-time audio into a .mp3 or a .wav file?
- I can't use unnest tokens properly when importing from excel
- How to fine-tune a llm for fine-grained sentiment analysis?
- Sentiment Analysis: tokenized data cannot fit in Keras model, Failed to convert a NumPy array to a Tensor (Unsupported object type numpy.ndarray)
- (Huggingface) Using fine tuned mode for inference over a dataset
- Why the value of accuracy is the exact same every epoch while training a sentiment analysis model?
- I ran a VADER sentiment analysis on mulitple files and the compound score for all of them was 1; how can I validate this result?
- Error deploying python flask app on heroku
- Must have equal len keys and value when setting with an iterable error
- How to fix invalid index to scalar variable Using NLTK | Python
- Model Accuracy Using Transformer
Related Questions in VADER
- I ran a VADER sentiment analysis on mulitple files and the compound score for all of them was 1; how can I validate this result?
- Using fully custom lexicon for VADER sentiment analyzer
- IndexError: index out of range in self ( Google Colab notebook ) while implementing Roberta Pretrained Model
- nltk code in google colab works and returns real values, but in jupyter notebook only zeros
- How to labeling text based on aspect term and sentiment
- Creating a progress bar for sentiment analysis in R
- What could be the reasons for vader_df() giving NA compound scores in R?
- vaderSentiment TypeError: 'float' object is not iterable
- how do i solve AttributeError: 'float' object has no attribute 'encode'
- Using "ifelse" with negative values - R
- Vader Sentiment Analysis in R
- Pandas code running but not doing anything
- Daily Sentiment Values
- Cant seem to iterate over a column to assign sentiment values
- Iterating over a DataFrame and appending the score into a column
Popular Questions
- How do I undo the most recent local commits in Git?
- How can I remove a specific item from an array in JavaScript?
- How do I delete a Git branch locally and remotely?
- Find all files containing a specific text (string) on Linux?
- How do I revert a Git repository to a previous commit?
- How do I create an HTML button that acts like a link?
- How do I check out a remote Git branch?
- How do I force "git pull" to overwrite local files?
- How do I list all files of a directory?
- How to check whether a string contains a substring in JavaScript?
- How do I redirect to another webpage?
- How can I iterate over rows in a Pandas DataFrame?
- How do I convert a String to an int in Java?
- Does Python have a string 'contains' substring method?
- How do I check if a string contains a specific word?
Trending Questions
- UIImageView Frame Doesn't Reflect Constraints
- Is it possible to use adb commands to click on a view by finding its ID?
- How to create a new web character symbol recognizable by html/javascript?
- Why isn't my CSS3 animation smooth in Google Chrome (but very smooth on other browsers)?
- Heap Gives Page Fault
- Connect ffmpeg to Visual Studio 2008
- Both Object- and ValueAnimator jumps when Duration is set above API LvL 24
- How to avoid default initialization of objects in std::vector?
- second argument of the command line arguments in a format other than char** argv or char* argv[]
- How to improve efficiency of algorithm which generates next lexicographic permutation?
- Navigating to the another actvity app getting crash in android
- How to read the particular message format in android and store in sqlite database?
- Resetting inventory status after order is cancelled
- Efficiently compute powers of X in SSE/AVX
- Insert into an external database using ajax and php : POST 500 (Internal Server Error)
The short answer is "no".
The README file on the github page states
but if you take a look at what is actually done for this demonstration (beginning at line 552 in the current version of vaderSentiment.py), this is based entirely on using a machine-translation web service to automatically translate the text into English. As such, the results are reliant not only upon the accuracy of the sentiment analysis tool but also upon the accuracy of whichever translation tool you use to create the English version of the input.
Vader only performs sentiment analysis on English texts, but that workaround (automatic translation) may be a viable option. Sentiment analysis is less sensitive to common machine translation problems than other usages*, but you'll certainly still have to keep the limitations in mind if you choose to use that workaround.
*To give an example, the service used in the demo translates "Das Internet funktioniert heute nicht. Ist eine Störung bekannt?" to "The Internet was not working today. Is a disorder known?", which would be more accurately translated as "The internet isn't working today. Is a disruption known?". It's got the tense wrong in the first sentence, and while there are several legitimate translations of "Störung" in this context, "disorder" is an awkward choice at best. Nevertheless, while this makes it quite a bad translation in general, the errors are unlikely to affect a sentiment analysis significantly.