Mirroring/Syncing MKLIVE

[dcung]

I thought I download https://debiandog.github.io/MakeLive/ for my learning.
I did that few weeks ago. I haven't really done anything about it yet.
I used wget when I downloaded it then - almost 2GB of data.

Code: Select all

wget -r https://debiandog.github.io/MakeLive/

I'd like to keep it up-to-date though.
So, what is the recommended way to go about it - ie. syncing/mirroring?
I figure learning from other's experience is more efficient than re-downloading or experimenting what command to use.
Preferably something that have log file to indicate what changes when syncing is done.

Locally I used either robocopy or grsync when I moved/copy/backup/sync stuffs.
I have not much experience backup/syncing from the net.

[fredx181]

@dcung I think that using git is the most solid (I use git, but very basic, just push from time to time to my repos, so I don't have much knowledge about it)
The following should work:

• first time, use clone (will create MakeLive directory with all inside):
  EDIT: added --depth 1, then it doesn't contain ALL history in the .git folder, only from last time commit, if I understand well.
  git clone --depth 1 https://github.com/DebianDog/MakeLive.git

• to update, from terminal standing in the MakeLive directory (this will sync with the remote changes and gives messages about it, or says something like "Already up-to-date" if no changes):

  Code: Select all

  git init
  git remote add origin https://github.com/DebianDog/MakeLive.git
  git fetch --all
  git pull origin gh-pages

Got some info from here /https://stackoverflow.com/questions/362 ... one-in-git

P.S. It's huge, lots of old (outdated ) stuff kept in there too.

[dcung]

...

• first time, use clone (will create MakeLive directory with all inside):
  git clone https://github.com/DebianDog/MakeLive.git
  ...
  P.S. It's huge, lots of old (outdated ) stuff kept in there too.

@fredx181 Thank you!

I only ever knew/used git clone command...when compiling Realtek WiFi driver...only 5MB stuff.

I just did your commands above.

Code: Select all

root@fujitsu-i5:/mnt/sda3/MKLIVE-GIT# cd MakeLive/
root@fujitsu-i5:/mnt/sda3/MKLIVE-GIT/MakeLive# git init
Reinitialized existing Git repository in /mnt/sda3/MKLIVE-GIT/MakeLive/.git/
root@fujitsu-i5:/mnt/sda3/MKLIVE-GIT/MakeLive# git remote add origin https://github.com/DebianDog/MakeLive.git
error: remote origin already exists.
root@fujitsu-i5:/mnt/sda3/MKLIVE-GIT/MakeLive# git fetch --all
Fetching origin
root@fujitsu-i5:/mnt/sda3/MKLIVE-GIT/MakeLive# git pull origin gh-pages
hint: Pulling without specifying how to reconcile divergent branches is
hint: discouraged. You can squelch this message by running one of the following
hint: commands sometime before your next pull:
hint: 
hint:   git config pull.rebase false  # merge (the default strategy)
hint:   git config pull.rebase true   # rebase
hint:   git config pull.ff only       # fast-forward only
hint: 
hint: You can replace "git config" with "git config --global" to set a default
hint: preference for all repositories. You can also pass --rebase, --no-rebase,
hint: or --ff-only on the command line to override the configured default per
hint: invocation.
From https://github.com/DebianDog/MakeLive
 * branch            gh-pages   -> FETCH_HEAD
Already up to date.
root@fujitsu-i5:/mnt/sda3/MKLIVE-GIT/MakeLive#

It's 5.5GB...using git.
The wget I did was 1.9GB...and that includes all from Jesse, etc, etc.
MikeLive only was 1.2GB.

Wow...what other stuff is in the git...
.
.
Edit:
Look - the control stuff is 4.3GB...!

2024-07-21-191520_416x489_scrot.png (46.67 KiB) Viewed 519 times

[fredx181]

...
- first time, use clone (will create MakeLive directory with all inside):
git clone https://github.com/DebianDog/MakeLive.git
...
P.S. It's huge, lots of old (outdated ) stuff kept in there too.

....

It's 5.5GB...using git.

Wow...what other stuff is in the git...
.
.
Edit:
Look - the control stuff is 4.3GB...!
2024-07-21-191520_416x489_scrot.png

Yeah, tested now, 5.5GB, for me too. That's absurd , don't know why exactly, I think it contains all history, even from the 11 release tags.
This is probably better for your needs, to start from the beginning, add --depth 1, then it does not contain ALL history in the .git folder, only from last time commit, if I understand well.
git clone --depth 1 https://github.com/DebianDog/MakeLive.git
Tested that and the .git folder became *only* 1GB and the files are all there (edit: total 2.2GB).
Edited my previous post with this change.
(strange thing is BTW that in my local MakeLive folder (from where I always push the changes to github, for years already), the .git folder is 1.7GB, not 4.3GB ).

[dcung]

...
git clone --depth 1 https://github.com/DebianDog/MakeLive.git
Tested that and the .git folder became *only* 1GB and the files are all there (edit: total 2.2GB).
Edited my previous post with this change.
(strange thing is BTW that in my local MakeLive folder (from where I always push the changes to github, for years already), the .git folder is 1.7GB, not 4.3GB ).

Ok, I did it again with --depth 1.
Same result with your test...better than 5.5GB... I suppose...

Thanks @fredx181