Online storage with ability of direct download? (Solved)

[taersh]

Hi.

I'm currently working on some different programs for Puppy. To get them working properly together I would need an online storage offering the ability to download directly from that storage without the need to open a browser and go to the page. My Google drive account doesn't offer such ability. The online storage also should not force others to register to download a file by a given link.

Just using the Puppy download_file script.

E.g. download_file CompleteLinkToFileHere.

Any suggestions, that will work with almost long term service?

Thanks in advance.

[taersh]

Ok.

It seems that archive.org has ability of direct downloads without to use browser and to go to the page.
For some years I do have an account at archive.org, which I do forget from time to time.
I think this will fit my needs.

[williwaw]

https://github.com/odeke-em/drive#automation-scripts

[p310don]

rclone would do the job for you by the sounds of it. I wrote a how to here:

viewtopic.php?f=85&t=616

[taersh]

Guys!

I don't need automation scripts to be setup first by myself and anyone else user to get direct access to my files!

I need online storage which lets me download directly without the need to visit the page via the browser and which would let anyone else with the link download directly without the need to visit the page via the browser!

[peebee]

SourceForge

[garnet]

Errr ... get a webhosting service? Setup your own simple website with nothing other than those files?

[user1111]

Template/example of cli based downloading a file from googledrive using curl ...

Code: Select all

# https://drive.google.com/file/d/1WzYtLXX2_kFcUFn7Ogi3vxaSDD2hNgXJ/view?usp=sharing
fileId=1WzYtLXX2_kFcUFn7Ogi3vxaSDD2hNgXJ
fileName=initrd

curl -sc /tmp/cookie "https://drive.google.com/uc?export=download&id=${fileId}" > /dev/null
code="$(awk '/_warning_/ {print $NF}' /tmp/cookie)"  
curl -Lb /tmp/cookie "https://drive.google.com/uc?export=download&confirm=${code}&id=${fileId}" -o ${fileName} 

BUT! Google have flagged that file as 'abuse' - so can't now be downloaded (at all, either using the above or via the browser).

Basically after you've uploaded and shared a file, note the filename and its 'share link' and extract the file id value from that share link and set those as the first two values.

Works for larger files. With smaller files it works, but can create duplicate copies (so you have to do some housekeeping after download).

[taersh]

Errr ... get a webhosting service? Setup your own simple website with nothing other than those files?

Great idea!

You'll pay for the website and data transfer etc.pp.?

I don't have that much money.

[Wiz57]

Hiya taersh,
I've used Onedrive, even though it is from Microsoft (I've had it a LONG LONG time), don't think others
need to login to download a file if you place them in the "public" folder, with appropriate sharing set.
If you want to test the download with no login, try my link here :

viewtopic.php?f=2&t=791&start=30

The file is an old ISO of 01Micko's Slacko 5.6.4 non-PAE. You should not have to login to download it.
Wiz

[garnet]

Great idea!

You'll pay for the website and data transfer etc.pp.?

You're very funny ^_^
It's your project, why should I or anyone else pay for it? ^_^

I don't have that much money.

Well, some of these web hosting services have monthly costs that are literally less than a cup of coffee in a developed country. If you really cannot even afford a cup of coffee, then I'm really sorry about your situation.

[taersh]

No, I'm not funny. You're the funny person here.

If I could spent the money for my own web-server and file-hosting, I would not asking for online service.

Also, the problem is not the cost of the file hosting. The problem is the cost of the data transfer, which could increase very much when lots of huge files are downloaded. I had once my own website with space to store and to download files from. I had to stop that because of too many files downloaded, so I couldn't pay such huge sums of money anymore.

Do you have something useful to distribute here and/or on the forum in general, or are you just annoying by your comments?

I'm just asking, since I have seen lots of such annoying comments of yours lately on the forum.

Edit:

As I wrote, I have an account at archive.org, which seems to fit my needs. Solved.

[taersh]

Hiya taersh,
I've used Onedrive, even though it is from Microsoft (I've had it a LONG LONG time), don't think others
need to login to download a file if you place them in the "public" folder, with appropriate sharing set.
If you want to test the download with no login, try my link here :

viewtopic.php?f=2&t=791&start=30

The file is an old ISO of 01Micko's Slacko 5.6.4 non-PAE. You should not have to login to download it.
Wiz

Hi.

I want user to be able to download files using the download file in Puppy: download_file LinkHere. This works on archive.org.

I've tried your link:

Code: Select all

download_file https://1drv.ms/u/s!Ao-_qqv5iz91gS_gcmdsww-w_VOj?e=sgeHCr

Doesn't work.

Code: Select all

root# 
root# download_file https://1drv.ms/u/s!Ao-_qqv5iz91gS_gcmdsww-w_VOj?e=sgeHCr
bash: !Ao: event not found
root#

[Wiz57]

Hiya taersh,
I've used Onedrive, even though it is from Microsoft (I've had it a LONG LONG time), don't think others
need to login to download a file if you place them in the "public" folder, with appropriate sharing set.
If you want to test the download with no login, try my link here :

viewtopic.php?f=2&t=791&start=30

The file is an old ISO of 01Micko's Slacko 5.6.4 non-PAE. You should not have to login to download it.
Wiz

Hi.

I want user to be able to download files using the download file in Puppy: download_file LinkHere. This works on archive.org.

I've tried your link:

Code: Select all

download_file https://1drv.ms/u/s!Ao-_qqv5iz91gS_gcmdsww-w_VOj?e=sgeHCr

Doesn't work.

Code: Select all

root# 
root# download_file https://1drv.ms/u/s!Ao-_qqv5iz91gS_gcmdsww-w_VOj?e=sgeHCr
bash: !Ao: event not found
root#

Hmm, I wonder if this failure has something to do with TLS, SSL or other security settings
that are available in most up-to-date web browsers but not in/accessible via bash??
Seems there was a topic here on the forums asking about something similar...but in my
ineptitude I can't find it now!
I just tried my link in Palemoon 28.14.2 32 bit not logged into Onedrive, the download
started as I intended, though it took a bit of time. I did notice that the web page containing
my Public folder had to load first, status line at bottom showed TLS handshakes, etc
occuring.
Wiz

[taersh]

Never mind.
Archive.org seems to work fin for my purpose.

I tested it yesterday by trying to download my VSP Puppy via Puppy script download_file.

Code: Select all

download_file https://archive.org/download/Puppy_Linux_VSP/VSP-Lucid-2013-01-20.iso

[williams2]

root# download_file https://1drv.ms/u/s!Ao-_qqv5iz91gS_gcmd ... j?e=sgeHCr
bash: !Ao: event not found

The bash/sh/ash shell treats certain characters as special characters.

For example, ! will execute a command in the bash history.
!137 will execute line number 137, whatever it is.
!cat will execute the last command in history beginning with "cat"

In this case, you need to put the url address in single quotes
or escape the ! character by putting a \ character before the ! character.

That is, change "!" to "\!"

It should download if you escape the special shell characters.

[taersh]

Nope!

Tested both suggestions Single Quotes and Escape.

Doesn't work. The test for file existing failed from download_file script.

Tested again on archive.org using a fresh uploaded test file: WORKS pretty good.

[garnet]

No, I'm not funny. You're the funny person here.

You must be very fun at parties ^_^

If I could spent the money for my own web-server and file-hosting, I would not asking for online service.

Also, the problem is not the cost of the file hosting. The problem is the cost of the data transfer, which could increase very much when lots of huge files are downloaded. I had once my own website with space to store and to download files from. I had to stop that because of too many files downloaded, so I couldn't pay such huge sums of money anymore.

A very useful background information, thanks ^_^

Something that nobody would ever know unless they're mind readers. It would have been helpful to provide this "little details" on your first post, so silly people like me doesn't try to offer such silly advices that involve you paying for things that you want (even if it only costs a cup of coffee).

By the way, I still stands by what I wrote. I don't know when you had your websites, or which provider you used, or how much "huge sums" you have paid before; but as of today, there are plenty of "cup of coffee" providers with "unlimited" data transfer, and those who aren't unlimited, usually has a monthly cap and if you exceed that cap, they simply cut off the network until next month, instead of charging you, so you will never be charged "huge sums".

Do you have something useful to distribute here and/or on the forum in general, or are you just annoying by your comments?

I don't know that "contribution" is a requirement before one is allowed to comment? I certainly didn't see that anywhere in the terms and conditions when I registered, nor do I see this as a requirement to participate in this section, or this thread O_o

How do you measure contribution, anyway? By uploading stuff? By helping? Or by calling other people who are trying to help you "annoying" just because you don't like their suggestions? ^_^

I'm just asking, since I have seen lots of such annoying comments of yours lately on the forum.

A friend told me that this forum is the most friendliest Linux forum on the planet, so I thought I'd come and see. So far this has been true - most exchanges I had have been very pleasant.

I don't know how I ruffled your feathers for trying to help you, and which ones of my "lots of comments" (in threads which you aren't even "contributing"?) are annoying you O_o

You are the first ever person in this forum who says I'm annoying. That's quite an honor ^_^
As I said, you must be quite fun at parties ^_^

Edit:

As I wrote, I have an account at archive.org, which seems to fit my needs. Solved.

I'm happy for you ^_^

[garnet]

Hi williams2,

https://1drv.ms/u/s!Ao-_qqv5iz91gS_gcmd ... j?e=sgeHCr

When I did this with wget, I ended up downloading an HTML file.

Code: Select all

# set +H
# wget -q "https://1drv.ms/u/s!Ao-_qqv5iz91gS_gcmdsww-w_VOj?e=sgeHCr"
# file s\!Ao-_qqv5iz91gS_gcmdsww-w_VOj\?e\=sgeHCr 
s!Ao-_qqv5iz91gS_gcmdsww-w_VOj?e=sgeHCr: HTML document, ASCII text, with very long lines, with CRLF, LF line terminators

So it doesn't seem to work?

[sc0ttman]

For free, reliable, fast, useful online storage, without ads, popups, hacky download scripts - I've said it before, and I'll say it again - GitHub.. GitHub, GitHub, Github.

Each repo has 1GB limit, you can have as many repos as you like..

You can also use something called "git-lfs" (git large file storage) to store even bigger things..

Or Gitlab.. Very similar to GitHub..

[williams2]

When I did this with wget, I ended up downloading an HTML file.
So it doesn't seem to work?

I saw in the original post that the error message was showing that some of the characters in the url needed escaping or to be put in single quotes.

But that url, when the bash special characters are properly escaped, still doesn't work with wget, because the url is intended to work using javascript, in a web browser. So, no, that url won't work with wget, even if the url is escaped properly. I did not check that it did work properly, which I should have done. What I did do, was point out the problem with bash special characters.

[garnet]

@williams2, thank you.