Public Remote Media Server Project


Re: Public Remote Media Server Project

Postby sofar » Wed Mar 20, 2019 5:30 am



done (did a few more than this)



These are largely duplicates of minetest_game, causing my server to needlessly duplicate tons of files and consuming large amounts of space for no reason, so I'd rather not.

If there is a place where I can get the mods separately, I would add them though.

Lejo wrote:What about automatic adding mods at content.minetest.net?


Well, not yet, I'd rather track git for now. contentdb mods are things that end users download. Server owners are more likely to use git to track updates, so contendb is likely outdated. On top of that, zipfiles are bandwidth inefficient and would waste bytes, plus I'd have to write a scraper, so all in all this is more work for little gain where git already works well.
sofar
Developer
 
Posts: 2086
Joined: Fri Jan 16, 2015 7:31 am
GitHub: sofar
In-game: sofar

Re: Public Remote Media Server Project

Postby sofar » Wed Mar 20, 2019 5:40 am

Quick stats on the server:

last full week: 13gb total, 3k unique visits, 1.6 million files requested. Fairly close to my last status update numbers.

5.0.0 and 5.1.0-dev clients are becoming more and more used.
sofar
Developer
 
Posts: 2086
Joined: Fri Jan 16, 2015 7:31 am
GitHub: sofar
In-game: sofar

Re: Public Remote Media Server Project

Postby Lejo » Thu Mar 21, 2019 1:20 pm

Ah, You are saving all this mods.
What about just cloning one, pulling out all medias and deleting the clone afterwards?
Then you only need storage for the textures and not for duplicate textures or other mod files.
Lejo
Member
 
Posts: 496
Joined: Mon Oct 19, 2015 4:32 pm
GitHub: Lejo1
In-game: Lejo

Re: Public Remote Media Server Project

Postby sofar » Thu Mar 21, 2019 9:03 pm

Lejo wrote:Ah, You are saving all this mods.
What about just cloning one, pulling out all medias and deleting the clone afterwards?
Then you only need storage for the textures and not for duplicate textures or other mod files.


The server checks for updates to the mods 15+ times a day. The above suggestion isn't worth the effort.
sofar
Developer
 
Posts: 2086
Joined: Fri Jan 16, 2015 7:31 am
GitHub: sofar
In-game: sofar

Re: Public Remote Media Server Project

Postby Lejo » Fri Mar 22, 2019 12:33 pm

sofar wrote:The server checks for updates to the mods 15+ times a day. The above suggestion isn't worth the effort.

Yes that’s a bit often. :D
I normally update the mods just @midnight
Lejo
Member
 
Posts: 496
Joined: Mon Oct 19, 2015 4:32 pm
GitHub: Lejo1
In-game: Lejo

Re: Public Remote Media Server Project

Postby sofar » Sat Mar 23, 2019 11:06 am

Lejo wrote:Yes that’s a bit often. :D
I normally update the mods just @midnight


Updating from git takes 2 seconds, for all the 100+ mods.

Having to download mods and then scrub them would take minutes. Assets are the bulk of the storage space needed, and the script I use to do all this already gc's the repos.

Even at once a day your proposed method would be much more resource intensive.
sofar
Developer
 
Posts: 2086
Joined: Fri Jan 16, 2015 7:31 am
GitHub: sofar
In-game: sofar

Re: Public Remote Media Server Project

Postby sofar » Wed Apr 03, 2019 4:28 am

Major update:

The server now supports HTTP/2 and SSL! HTTP/2 is a much more efficient protocol than HTTP/1.x and supported by libcurl, which is what every Minetest client uses to connect to the remote media server. Therefore, from now on, everyone can change their server configuration to point clients to the https://address of the PRMS:

enable_remote_media_server = true
remote_media = https://minetestmedia.foo-projects.org/


Cheers!

HTTP access will continue to work for the foreseeable future, so that server owners can upgrade to HTTPS over time.
sofar
Developer
 
Posts: 2086
Joined: Fri Jan 16, 2015 7:31 am
GitHub: sofar
In-game: sofar


Re: Public Remote Media Server Project

Postby sofar » Wed Apr 03, 2019 9:20 pm



This mod has no license statement at all, or at least not that I can find. Therefore, I can't add it.

The rest will be added.
sofar
Developer
 
Posts: 2086
Joined: Fri Jan 16, 2015 7:31 am
GitHub: sofar
In-game: sofar

Re: Public Remote Media Server Project

Postby sofar » Wed Apr 03, 2019 9:22 pm

I'm dropping Solar_plains as I don't think any server is using this atm (it's large, 1/3rd of the storage space the PRMS needs)
sofar
Developer
 
Posts: 2086
Joined: Fri Jan 16, 2015 7:31 am
GitHub: sofar
In-game: sofar

Re: Public Remote Media Server Project

Postby Calinou » Sat Apr 27, 2019 5:53 pm

Could https://github.com/minetest-mods/gauges be added to the list? The textures are pretty small but it might still help a little with loading times.
Calinou
Moderator
 
Posts: 3154
Joined: Mon Aug 01, 2011 2:26 pm
GitHub: Calinou
In-game: Calinou

Re: Public Remote Media Server Project

Postby LMD » Sat Apr 27, 2019 8:54 pm

Is a simple media server enough(a http webserver such as Apache serving files) ? Or do I need special software ? I'd like to set up my own.

EDIT : Saw https://github.com/minetest-tools/mtmed ... er/main.go, would like to write my own/(using Java) - where can I access the specifications ? I am working thinking dreaming of a Minetest Server Edition with all the necessary tools to maintain a server. And would like to write a remote media server requiring nothing but Java, probably even with GUI.
LMD
Member
 
Posts: 714
Joined: Sat Apr 08, 2017 8:16 am
GitHub: appgurueu
In-game: LMD + PRO_LMD + Limo

Re: Public Remote Media Server Project

Postby sofar » Sat Apr 27, 2019 9:40 pm

LMD wrote:EDIT : Saw https://github.com/minetest-tools/mtmed ... er/main.go, would like to write my own/(using Java) - where can I access the specifications ? I am working thinking dreaming of a Minetest Server Edition with all the necessary tools to maintain a server. And would like to write a remote media server requiring nothing but Java, probably even with GUI.


Why on earth do you want to use Java to reimplement it? The current implementation is working fantastically well and very efficient (low CPU/RAM usage), and can be compiled to run on windows if needed. Right now, the PRMS is sitting at 23mb RSS! And that includes data in-memory on 16707 media files!

Don't waste your time, the `mtmediasrv` daemon is feature complete and stable. You're literally throwing software development time into the toilet and are far better off spending it on some new service that doesn't exist yet. If you're a fan of wasting engineering resources or "you just want to learn", I'm not going to stop you, but there are entirely better ways to do both those things, AND make something new.

Note: as a language choice, Java is a really poor choice for anyone using Minetest as a lot of people are looking for low overhead services, and Java is the opposite of light weight. In other words: you're choosing a language which deters most players and server owners. That's your mistake, not theirs.

If you're still not deterred, have at it! The spec is in the MT code, essentially. Of course, the mtmediasrv implementation is really decent and should be an excellent guide.
sofar
Developer
 
Posts: 2086
Joined: Fri Jan 16, 2015 7:31 am
GitHub: sofar
In-game: sofar

Re: Public Remote Media Server Project

Postby sofar » Sat Apr 27, 2019 9:41 pm

Calinou wrote:Could https://github.com/minetest-mods/gauges be added to the list? The textures are pretty small but it might still help a little with loading times.


Added
sofar
Developer
 
Posts: 2086
Joined: Fri Jan 16, 2015 7:31 am
GitHub: sofar
In-game: sofar

Re: Public Remote Media Server Project

Postby LMD » Sun Apr 28, 2019 8:23 am

sofar wrote:The spec is in the MT code, essentially.

Ouch.
LMD
Member
 
Posts: 714
Joined: Sat Apr 08, 2017 8:16 am
GitHub: appgurueu
In-game: LMD + PRO_LMD + Limo

Re: Public Remote Media Server Project

Postby sofar » Mon Apr 29, 2019 3:02 am

LMD wrote:Ouch.


I wasn't joking when I said that coding it in Java was a waste of time.
sofar
Developer
 
Posts: 2086
Joined: Fri Jan 16, 2015 7:31 am
GitHub: sofar
In-game: sofar



Return to Minetest-related projects



Who is online

Users browsing this forum: Yandex Bot [Bot] and 0 guests