Search Log [RESOLVED]

[alacritous]

Hello,
I run a web server, on my server, and there is a log file that logs all the actions that occur. Well, there is tons of different actions per ip address. I want to filter out the whole log file and get the ips, but not showing the same ip twice, so there is a clear list with all the ips. I just need to know a good method, as I know the string commands.

alacritous

[RobDog888]

One way would be to load all the ip addresses into a temp table
and then run a DISTINCT query and insert the query results into
a final table. Delete the temp table and you are left with a table
of distinct ip addresses.

HTH

[alacritous]

How would I even find the IPs? I think it starts with one on each line. If it does, then it will be easy. I'll have to show you some of it, sorry I didn't earlier.

It'll be in a little while until I can show you, sorry.

[RobDog888]

You should be able to parse the ips out of each line in the log file.
You just need to find something that can be used to designate
the start and end of an ip address. You can use Left, Mid, and
Len to parse it out.

HTH

[dglienna]

Why do you want to know the IP addresses of anybody?
As long as nothing bad has happened, you should just forget about them.

[ice_531]

Originally posted by dglienna
Why do you want to know the IP addresses of anybody?
As long as nothing bad has happened, you should just forget about them.

To start his own world domination scheme like VBD (see chitchat for further information)

Maybe he wants the file to be neater? (log file that is) if it happens to be jumbled up together with ip:action:time:action:action:anotherip:action:anotherip2: ......get the point?


But yes you can use the string functions Robdog posted... or could even use the split function using a delimiter depending on what all is in the log file. please post an example with fake ips though.

ice

[alacritous]

I run a webserver, and the statistics don't give a great deal of information. It says how many times ANYONE has visited ANY html page. That also goes for the images and stuff. I would like to know the exact amount of people, and I could, yes, either use a free counter, but I'd rather create my own which would also give more detail.

I am really busy at the moment, but yeah, I figured the len, right, left, mid, all that stuff would work, so I'll just use that and find the end of the ip somehow.

alacritous

[alacritous]

Hello,
Sorry, I've been busy for a while. I have filtered out all the IPs, but there are doubles. How can I get rid of the doubles? BTW, it's so big of a file, I had to split it 4 times. But even then, each file is 6,000 lines + so keep that in mind.

Thanks,
alacritous

[dglienna]

import them into access, making them a key
this will sort them as well

[RobDog888]

Or after they are imported into Access, do a SELECT DISTINCT
query and then insert those records into another table. Then
cleanup by deleting the initial table's records.

HTH

[alacritous]

...

code

[alacritous]

anyone?

[RobDog888]

Sorry for the delay.
After you import all the records into the TableTemp using ADO or
whatever, run these two queries.

INSERT INTO 
 IPVisitors (
  IPAddress,
  Field2,
  Field3)
 SELECT DISTINCT
  IPAddress,
  Field2,
  Field3 
 FROM
  TableTemp
 ORDER BY
  IPAddress ASC;

DELETE * FROM TableTemp;

[alacritous]

Odd...

I didn't ask for it using access... Maybe I should have specified it better before...

all code please!

alacritous

edit: i know this has nothing to do with this, but I was hoping if someone knew why when I install microsoft office XP it hangs up on the file (sry cant get it right now) something like OWSCLT.DLL and doesn't install.

last time when I reformatted, once I installed winXP service pack it worked, but obviously its not now...

[RobDog888]

Sorry, but I dont have allot of time to write the program for you.
I need to finish a program for a client. Needs to be under budget.

If you are unsure of how to connect to and insert records into
access then perhaps a search or another thread in the
databases forum. Maybe try first and others will help if you get
stuck.

The queries I gave you will work for either Access or SQL.

[alacritous]

Originally posted by RobDog888
Sorry, but I dont have allot of time to write the program for you.
I need to finish a program for a client. Needs to be under budget.

If you are unsure of how to connect to and insert records into
access then perhaps a search or another thread in the
databases forum. Maybe try first and others will help if you get
stuck.

The queries I gave you will work for either Access or SQL.

***? Am I speaking?
I know how to do that. Who said I was going to do it that way? I said CODE not records...

I never said to write code for me. I asked how to get rid of doubles. For instance:

It would make:
ip1
ip1
ip2
ip3
ip4
ip4

Into:
ip1
ip2
ip3
ip4

alacritous

[leinad31]

And he did give you a solution by dumping the info into a database so you can use SQL to filter out the records you need and transfer them to another table. You can then read of the unique IP addresses off the second table.

Either use that or filter the info manually through an nested iteration of an array or collection.

[alacritous]

Like I said, and I'll say it again which I will probably have to even more. I DO NOT want to dump it.

How would I do it with the array thing?

alacritous

[RobDog888]

If you dont want to dump it the take the subquery and make it a
permenant query in Access. Then you can use it as the source
for a report. The report will show all ips and no dups. Still
retaining the entire table. No dumping. Dude, I don't appreciate
the 'tude. After all we are helping you for free. I should stop
myself here, so I will.


Import all records into table Table1. Then make this a query and
set it as the recordsource for an Access report.

Done!

 SELECT DISTINCT
  IPAddress,
  Field2,
  Field3 
 FROM
  Table1
 ORDER BY
  IPAddress ASC;

[leinad31]

Use a collection

On Error Resume Next
   For/Do/While iteration through all IP addresses
      strIPAddress = An IP from source structure
      colTemp.Add strIPAddress, strIPAddress
      If Err Then Err.Clear  'catch error produced with duplicate key hence duplicate IP
   Next/Loop/Wend
On Error Goto 0

Resulting collection will be one copy of each IP.

If dont want to iterate throug the struct (eg direct InStr from the file) you can make the collection module level and create an add functiuon(strIP As String) with the error trapping so you don't have to recode the error trap.

[alacritous]

RobDog888, I don't need people helping me that can't read what I say. Thank you thus far, though.

leinad31, thank you so much. This is perfect!

Thanks!
alacritous

[RobDog888]

Your welcome, although like you say can't read. Then you should
have been able to read the previous posts to see that the
solution was posted there.

Don't worry, I will not help you again.