How does self attention help in deciding references

26 views Asked by At

Consider the two sentences: "The animal did not cross the road because it was too tired" and "The animal did not cross the road because it was too crowded". How does the self attention mechanism determine that in the first case "it" refers to "animal" and in the second case to "road"?

0

There are 0 answers