[Info-vax] scp or sftp: file is "raw", needs to be parsed - possible to work around that?

[Chris Townley]

On 19/05/2021 13:46, Gregory Reut wrote:
> Thank you Chris,
> I didn't try to zip the files as I don't think they will become small enough, but I'll give it a try!
> Best regards,
> Greg
> 
> On Wednesday, May 19, 2021 at 2:18:40 PM UTC+2, Chris Townley wrote:
>> On 19/05/2021 13:11, Gregory Reut wrote:
>>> Hi Simon,
>>>
>>> Thank you for replying!
>>> It's an backup saveset,created with BACKUP/IMAGE command from a DKA device, so I'd guess it's a sequential file. I eould give it a try with the stream if I'd know how to do that :) At least I can experiment on much shorter files (restore them on the target VMS system).
>>>
>>> Best regards,
>>> Greg
>>>
>>>
>>> On Wednesday, May 19, 2021 at 2:04:55 PM UTC+2, Simon Clubley wrote:
>>>> On 2021-05-19, Gregory Reut <gregor... at gmail.com> wrote:
>>>>> Hi all,
>>>>>
>>>>> Trying to scp a very large file off an Alpha VMS 8.3 system. Larger the file, longer it takes to start the transfer. This scp message in verbose mode gives a clue:
>>>>> SCP Source file is "raw", and it needs to be parsed
>>>>>
>>>>> Parsing a 20GB file takes longer than a standard scp timeout. and I need to scp files 10 times larger.
>>>>> Perhaps there is a way to skip the parsing?
>>>>>
>>>>> Thanks in advance!
>>>>> Greg
>>>> Is this a sequential file or are you trying to directly transfer the
>>>> records from a relative file or indexed file ?
>>>>
>>>> If its a sequential file, is it possible to create the file as a
>>>> Stream LF file or would that cause data corruption due to any possible
>>>> embedded characters in the data ?
>>>>
>>>> Simon.
>>>>
>>>> -- 
>>>> Simon Clubley, clubley at remove_me.eisner.decus.org-Earth.UFP
>>>> Walking destinations on a map are further away than they appear.
>> Have you tried zipping (with "-V") the saveset?
>>
>> I have had success using that in the past
>>
>> Chris
>>

The benefit of using ZIP is so much the compression, but retaining VMS 
attributes in a known format,

In the past I had a VMS system where the data backups were first disc to 
disc, then zipped up in a ZIP container file copied to a Unix machine 
over NFS and then to tape.
Worked well, and the compression was such that I could retain 2 weeks 
worth on-line


-- 
Chris Townley