Simon icon Simon
Flexible server monitoring

Tutorial for web page monitoring?

I saw this question asked back in 2012, so I'm going to ask it again!

I just downloaded the demo version, and the learning curve is steep for me. I'm a creative (I have no programming or even web design experience). I need to monitor IMDB pages in order to get alerts when people I have worked with in the past have new elements added to their profiles.

Specifically, I want to look only at a few specific CSS sections (sheets?) of the pages, and disregard everything else.

Is there anywhere where someone has created a walkthrough tutorial for laymen?

Thanks!

David Sinclair's picture

Re: Tutorial for web page monitoring?

Hi Matt,

I've written a few tips blog posts on Simon features (there are Time Out tips mixed in with that URL).

One that you may find helpful is the default "Dejal posts" test case study. There are some other examples in other blog posts, too.

Briefly, if you just want to look at a specific portion of a web page, your best bet is the "Block" filter, which lets you specify start and end text that wraps the relevant section; the test will only look between those. You can use the Preview pane to find the text to look for.

I hope this helps!

Re: Tutorial for web page monitoring?

Well, let me ask a more general question...

I currently use a windows program called Website Watcher to monitor pages. This is currently the only remaining PC app I use, so I'd love to find something for Mac that can do the same thing. Here's what I need:

Monitor a number of IMDB Pro pages for changes to only certain areas of the page. IMDB Pro requires a login, but once logged in, it usually keeps you logged in indefinitely. Sometimes, for no apparent reason, I get logged out.

When a change is detected, Website Watcher emails me a version of the new page with the changes highlighted. It doesn't email the HTML code... it actually emails me a version of the page that more or less matches the web layout version, expect the changes are highlighted.

In the event that something has been deleted from the page, it tells me what was deleted at the bottom of the email, after the web page.

Can Simon do this?

David Sinclair's picture

Re: Tutorial for web page monitoring?

Simon can certainly check a portion of the page for changes; you'd typically use the Block filter for this.

It can also log in to most sites by providing cookies, that you can record via the Preview.

Simon can also email you when something changes, via the Email notifier.

What it can't do is include a highlighted rendering of the page, though the email could include a link to the page. I would like to add a highlighted rendering at some point.

Re: Tutorial for web page monitoring?

I see. So in other words, it could include a link to the page, but then I would be on my own to actually recognize which content had changed?

If so then drat, I have to stay on this PC for a while longer. There is just too much data on the page I'm monitoring and the changes can be subtle. I really need the highlighting.

When this feature is added I'm assuming it will be noted on your blog?

David Sinclair's picture

Re: Tutorial for web page monitoring?

It can include the text that changed in the email notification, to help you find it. There's also a Context filter to include some of the text around the change, if that helps.

You could try using Simon to see if it works for you; there's a free trial. Maybe it'll work well enough for your needs.

Yes, I will certainly announce it on the blog (and Twitter etc) when that or other features are implemented. Though I don't have a timeline for when it might be; probably not for some time.

Re: Tutorial for web page monitoring?

HI David, I have the same question about monitoring the pages, but mine is how to use keywords to trigger notification. It's a pitty that filter "find" can only use one keyword, and I need to find lots of keywords, and if any of them appear, the notification will be triggered. The only way I thought is creating many filters but the cpu usage is too high. I hope the new function that different keywords can be used in one "find" filter.

Thanks!

David Sinclair's picture

Re: Tutorial for web page monitoring?

Hi,

You can use the Find Regular Expression filter (or a similar custom one) to find multiple keywords in one filter.

e.g. to find any of these words, search for:

foo|bar|baz

There are lots of other variations you can use with regex; it's a very powerful tool. Search Google for other examples.

Re: Tutorial for web page monitoring?

Thank u very much!It works! I'm so excited and I need to improve my ability! I'm so appreciate!

kcopland's picture

Re: Tutorial for web page monitoring?

I saw this on Twitter. I am a new mac user and am trying to figure out how to monitor from using my new system. I have an account on ChangeDetect which does a good job from the cloud, but it only monitors web pages every 12 hours max. I suppose I can just ask my son as he is the one who got me going on the Mac and I love it. Just need a bit more guidance for this.

David Sinclair's picture

Re: Tutorial for web page monitoring?

Welcome. Have a look at the Tips blog posts — there are a mix of Simon & Time Out tips there, but some helpful examples.

One particularly useful example is A Simon 4 case study: the default "Dejal posts" test, that breaks down how that fairly complex example test works.

If you have any specific questions, feel free to create a new forum post to ask.