Ok, so I figured out the best way to present this data.

I can output the data using something like:

xyz.com/test.php?name=JdS

I have since embedded it within the existing template using @include.

Now I just have to read JdS' tutorial on parsing PHP in html files, test it out and I'll be ready to go.

The moral of this story: I saw a script that did more than what I have done (I don't mind doing some work since the data feed doesn't change that often) for $100. And of course it was restricted to one domain, the one merchant, etc. So by asking a few questions, doing some research and a little bit of hacking around (programming), I saved enough for almost 4 cases of beer.

I am glad it all worked out for you... someday, I will add it to the Library.

The application went smoothly for my first project.

But for the second one is somewhat larger, with a larger database, etc. So I have been thinking about ways to optimize the script and have started looking at some caching utilities. Apart from that, my template system (Templatepower) doesn't seem as efficient with embedded php includes.

So, any ideas on php caching options? I just looked at Turck MMCache but I don't have the ability to compile it on my server. Another option would be phpCache (http://www.0x00.org/php/phpCache/). I'm not sure about the templating system...I might just use regular php includes.

That phpcache thingy, it's a bit old isn't it? If you can you should try convincing your host to install Turck MMCache... that's preferred but if you can't, you can't.

Another thing that I do nowadays when I write my newer scripts is to store common db data serialize()'ed. The PHP function pair of serialize() / unserialize() is funky to use when you find you are grabbing the same (or rarely changing) data off a db table often...

Yeah it is pretty old...I might look around a bit more for another caching system. Thanks.

Okay I am trying to use the code above to use a datafeed from one of my merchants, but I can't seem to get it to work. ( I AM VERY NEW TO PHP and mysql)

I created all the tables and put the data in but I am having troubles trying to use the data in any of my pages.

Could someone help me please?

Sincerely yours,
Pamela

Hello Pamela,

It may be a good idea for you to start a new thread with your question... and about your question, you definitely need to tell us what exactly you "can't seem to get to work"!

Can you run raw queries on you data? Do they yield relevant results? You might have to post a link or two and some of your code...

I have my script populating a large database. Some of the datafeed file sizes (txt files) are more than 70 MB. The main problem I have is errors or missing data in the feed, and categorizing the data into one category structure for multiple feeds.

Anyone found a good way to deal with this?
- John

That's the tough part John. I only use the subset of a feed from one merchant so its only 1-2 megs, but the 10-20 errors I usually come across have to be corrected by hand.