Fusepool
Named Entity
Recognition
Gábor Reményi, GeoX
Named Entity Recognition
(NER)
● Named Entities
o Persons, Organizations, Locations, Diseases,
Products, etc.
o The aim of...
Named Entity Recognition 2.
(NER)
● Uses statistical models to locate entities in texts
● Predicts the entities based on t...
Dictionary Matching
(SMA)
● Aho-Corasick dictionary-matching algorithm to
locate keywords in texts
o Alternative solution ...
SMANER versus SMA examples 1.
http://82.141.158.251/cner_v1/
1.: Mr. Washington lives in Seattle. He has a company named W...
SMA
New entitiesFalse positiveFalse negativ
NER versus SMA examples 2.
of 6

Named entity Fusepool project

Published on: Mar 3, 2016
Published in: Technology      
Source: www.slideshare.net


Transcripts - Named entity Fusepool project

  • 1. Fusepool Named Entity Recognition Gábor Reményi, GeoX
  • 2. Named Entity Recognition (NER) ● Named Entities o Persons, Organizations, Locations, Diseases, Products, etc. o The aim of NER is to locate entities in unstructured text documents ● Domains (NER models) o News-based o Mobile technology o Chemical elements o Cancer o Diseases
  • 3. Named Entity Recognition 2. (NER) ● Uses statistical models to locate entities in texts ● Predicts the entities based on the context of the text o Can recognize new entities  Entities outside of the training data o False positive entities o False negative entities ● Creating new models is very time-consuming o Well defined domain o List of entities from the domain o Considerate amount of annotated training text
  • 4. Dictionary Matching (SMA) ● Aho-Corasick dictionary-matching algorithm to locate keywords in texts o Alternative solution for entity extraction o Not model based, no training ● Digital search tree o Allows very fast search ● No prediction, only matching o Cannot find new keywords o No false +/- entities
  • 5. SMANER versus SMA examples 1. http://82.141.158.251/cner_v1/ 1.: Mr. Washington lives in Seattle. He has a company named Washington Iron Co. that is the biggest iron producer in Washington. 2.: Gabor Remenyi lives in Budapest. Gabor has a company named Remenyi Iron Co. that is the biggest iron producer in Hungary. 3.: Gabor Remenyi lives in Kiskunfalva. Gabor has a company named Remenyi Iron Co. that is the biggest iron producer in Hungary. 4.: Gabor Remenyi lives with Kiskunfalva. Gabor has a company named Remenyi Iron Co. that is the biggest iron producer in Hungary.
  • 6. SMA New entitiesFalse positiveFalse negativ NER versus SMA examples 2.

Related Documents