sync'ing using multiple filters

[yukiomishima]

JD

the Ist 2 "appeared" to be OK

the 3rd one is the one that i started noticing that everything being sync'ed was being sync'ed to the incorrect location

at your advice.... i started a whole new offiste file/folder structure (as outlined above)

the old folder/file structure is still on the remote ftp server.... but was only partially "cleaned-up" as i stopped the other application before it had finished

btw

is the 43mb transcript file just for the most recent sync... or from when i first started using YFTP or since the last time YFTP was started?

do i need to sort thru it and just send you the most recent stuff?

thanks

yukioMishima

[JD]

the Ist 2 "appeared" to be OK
the 3rd one is the one that i started noticing that everything being sync'ed was being sync'ed to the incorrect location

Ok, so for all you know it could have been going wrong in the first one and you just didn't notice?

at your advice.... i started a whole new offiste file/folder structure (as outlined above)

Ok, so delete this new one and start again. This time perform only one sync, then check thoroughly for errors. If there are errors, then send me the transcript.

We need to test that a single synch is successful. It doesn't make any sense that two synchs would work and the third not. Either it works or it doesn't.

is the 43mb transcript file just for the most recent sync... or from when i first started using YFTP or since the last time YFTP was started?

It depends how you use the scheduled Bookmark:

If you have the a FTP Browser window open from that Bookmark, then the scheduled synchs execute within it.  So if you select Save Transcript then you get the log from the time you opened the FTP Browser window, including any scheduled synchs that have executed and any other transfers or browsing you have done.

If you don't have an FTP Browser window open from that Bookmark, then the scheduled synchs execute in a small progress window which auto-dismisses after the synch has finished. In this case, selecting Save Transcript will only get the last synch log data.

I would advise the open FTP Browser window for our test.

Which do you normally use?

do i need to sort thru it and just send you the most recent stuff?

No, definitely don't touch the data at all.

[yukiomishima]

JD

the Ist 2 sync's worked correctly...... the Ist one built the folder structure and then populated with sub-folders and files

the 2nd sync worked correctly (though have not fully verified) and added files folders as necessary

the 3rd sync definately DID NOT work and sync'ed into the incorrect folders

i normally open the bookmark and have the FTP Browser window open

can i delete the current data in the transcript and start this all again?.... so that i have can shoot you thru relevant data?

i will set it up to only sync data since yesterday.... the 2nd sync will be data from 1 week ago... the 3rd sync will be data from 2 weeks ago

each sync will be drawing from the same local 300gb folder

should i create a bookmark for each sync... or just run the Ist sync and then modify the filter parameters

it will probably be a few days before i can get you the transcript as it will take that long to get the data from the server to the remote ftp site

please let me know how i should attack this new "test" and i will get it under way asap

thanks

yukioMishma

[JD]

the Ist 2 sync's worked correctly...... the Ist one built the folder structure and then populated with sub-folders and files
the 2nd sync worked correctly (though have not fully verified) and added files folders as necessary
the 3rd sync definately DID NOT work and sync'ed into the incorrect folders

Ok, with not fully verified I still don't feel very confident, but let's assume that only the last synch went wrong then

If that's the case then the existing 43mb transcript will show the mistaken uploads. It will also show the previous 2 synchs if you didn't close the FTP Browser window. If you re-opened the FTP Browser window for the last synch then only the last synch's transcript will be in there.

You will need to tell me which files/folders have been uploaded to the wrong places.

Please send it, plus the Bookmark and Preferences file as I described in my email.

i normally open the bookmark and have the FTP Browser window open

Ok, good.

can i delete the current data in the transcript and start this all again?.... so that i have can shoot you thru relevant data?

The transcript data is discarded immediately after you close the FTP Browser window. When you open the connection again, a new file is started.

i will set it up to only sync data since yesterday.... the 2nd sync will be data from 1 week ago... the 3rd sync will be data from 2 weeks ago

each sync will be drawing from the same local 300gb folder

Well, I have to wonder why you are doing it like this in the first place. Why 3 synchs when the last one will back up all the data. And also, why you are using a scheduled synch. Is it intended take place overnight usually, but you're manually starting them to test?

If I were testing this, I would do perform each sync manually, using the preview option to see what will be uploaded - that is one test I have asked for, in fact - and then I would thoroughly check everything to make sure the correct uploads were made and to the correct places. That way, it can be narrowed down to exactly which point the failure occurs.

should i create a bookmark for each sync... or just run the Ist sync and then modify the filter parameters

I'd actually prefer it if you closed the browser after each verified as successful synch and only send me the transcript of the synch that fails. It's a lot of data to wade through otherwise...

Again, you will need to tell me which files/folders have been uploaded to the wrong places.

it will probably be a few days before i can get you the transcript as it will take that long to get the data from the server to the remote ftp site

No problem. I am ready and waiting

please let me know how i should attack this new "test" and i will get it under way asap

If you can get me a single failed synch session transcript, plus the Bookmark and Preferences file, that will be what I need. Failing that, then 43mb file should prove interesting, but it will take me a few days to get through

[yukiomishima]

JD

the reason i am sync'ing the way i am is purely for testing

with 300gb of data locally and only a 768k line to the remote FTP server..... to sync the entire 300gb would take weeks and weeks... or.... months and months

so.... i am trying to get it down to bite size pieces for testing... hence backing up a day/week at a time going backwards

i will setup a brand new folder.... and sync all work done today

sync 02 will backup the last 7 days

sync03 the last 14

as there is ±50 to 10 gb of data / sync that will be backed up..... with hundreds of folders/sub-folders... it will take some time for the data to be uploaded AND for me to identify exactly when it is that it all goes belly up

but..... will get it all underway now.... and shoot thru the files requested files when i have them available

thanks again for all

yukioMishima

[JD]

the reason i am sync'ing the way i am is purely for testing

with 300gb of data locally and only a 768k line to the remote FTP server..... to sync the entire 300gb would take weeks and weeks... or.... months and months

so.... i am trying to get it down to bite size pieces for testing... hence backing up a day/week at a time going backwards

Ok understood. Thank you for making this clear.

i will setup a brand new folder.... and sync all work done today

sync 02 will backup the last 7 days

sync03 the last 14

Ok sounds good.

as there is ±50 to 10 gb of data / sync that will be backed up..... with hundreds of folders/sub-folders... it will take some time for the data to be uploaded AND for me to identify exactly when it is that it all goes belly up

but..... will get it all underway now.... and shoot thru the files requested files when i have them available

Yes, I am sorry. I know it's a pain, but it's the only way to narrow this down. I appreciate your patience. Thank you.

thanks again for all

You're welcome

[yukiomishima]

JD

email has been sent + files uploaded as instructed

please let me know if you require further

thanks

yukioMishima

[yukiomishima]

JD

just to follow-up

as you are probably aware by now...... the Ist sync worked correctly... setting up all of the approp folders/sub-foldrs and populating with the filtered files into a brand new folder on the remote FTP server

the 2nd sync (or.. in fact... the Ist actual sync between the data sets) got all funked up...... so it appears to happen immediately that the actual data is sync'ed and not... as i had mentioed in a previous message on the 3rd sync

hope this helps

looking forward to your findings and a solution to this issue

thanks again for all

yukioMishima

[paulc]

Just a generic FYI... text files like ftp transcripts compress HUGELY. I have seen such file shrink by 95+% on occasion. Part of the reason is that there are HUGE amounts of common data in such listings.

[yukiomishima]

so... after alot of testing, alot of very hard work and multiple beta versions it looks as if the problem has been resolved

JD has worked tirelessly on tracking down and solving the problem

i cannot praise him enough for all the hard work, dedication, persistence and tireless effort he has put in to solving this issue

after having tested all of Yummy's major competitors i have no hesitation in recommending yummy for its unmatched feature set, interface, ease of use and fantastic tech support.

once again, JD, HUGE HUGE thanks for all your time and effort in sorting this out

yukioMishima

[JD]

You're welcome! And thanks to you for all the help tracking it down ... it's been a pleasure working with you