|
|
#1
27-Mar-2004, 06:16
|
||||
|
||||
Building a search engine and handling HTML entities.I am trying to build a little search engine of my own for my next site. I am currently working on how to store the data that my little crawler will extract off my own web pages for all my present and future sites.
The question I am asking myself and I hope you will help me decide, is this: what am I supposed to do with the HTML entities like &, ", , ™, > or <... etc? Do I remove them from the content? Or do I translate them before saving the content to the search index? __________________
J de Silva Learning Journal | GIDForums™ | GIDNetwork™ | GIDWebhosts™ | GIDSearch™ |
|
#2
27-Mar-2004, 09:39
|
||||
|
||||
|
If you are going to do cached pages, you will need to leave them.
Can you explain some more why you would not want them? __________________
Mr. Bob's Web Design - Tirelessly looking for ways to enhance the customer base of your business. |
|
#3
27-Mar-2004, 16:21
|
||||
|
||||
|
No, no cached pages...
 I was asking since I wasn't sure. I guess I would need them (stored) already translated since a user might search using a snippet of code. If i have them stored as HTML entities instead, then the search would not match a search term like "<html>"?__________________
J de Silva Learning Journal | GIDForums™ | GIDNetwork™ | GIDWebhosts™ | GIDSearch™ |
Recent GIDBlog
Last Week of IA Training by crystalattice
| Thread Tools | Search this Thread |
| Rate This Thread | |
|
|
Network Sites: GIDNetwork · GIDWebHosts · GIDSearch · Learning Journal by J de Silva, The
