Guild icon
DDraceNetwork
Development / developer
Development discussion. Logged to https://ddnet.tw/irclogs/ Connected with DDNet's IRC channel, Matrix room and GitHub repositories โ€” IRC: #ddnet on Quakenet | Matrix: #ddnet-developer:matrix.org GitHub: https://github.com/ddnet
Between 2021-07-27 00:00:00Z and 2021-07-28 00:00:00Z
00:27
28c34bd Stop accepting invalid ipv4's - gerdoe-jr e78ba96 EOF - gerdoe-jr 01822ca EOF x2 - gerdoe-jr af3de10 Enable related tests - gerdoe-jr d0b7802 Merge #3969 - bors[bot]
Avatar
They look pretty much the same in our font, but for some reason, the inverted exclamation mark doesn't have confusables. Reported by Skeith: !image !image

Checklist

  • [ ] Tested the change ingame
  • [ ] Provided screenshots if it is a visual change
  • [ ] Tested in combinat...
Avatar
kangarro
Avatar
707e13f Update confusables_data.h to Unicode 13.0.0 - heinrich5991 1f68e11 Mark the inverted exclamation mark as confusable with i - heinrich5991 3d3c190 Merge #3972 - bors[bot]
Avatar
Anyone have any idea how I can figure out what some program is blocking on?
Avatar
Avatar
Learath2
pro-tip, having a couple instances of rsync running in parallel better saturates your connection if your files are very small
pro-tip-update: not if you are io bound : (
07:04
fs bound*
07:05
I so hoped exfat would be enough but the insane number of files we have in data/ger killed it
07:05
each time it tries to check if a file exists it now needs to travel down the linked list of files
07:09
I have a 64 megabyte directory entry, beat that ๐Ÿ˜›
Avatar
Q: Does anyone know whether I can create a ext4 filesystem inside a file?
Avatar
I see no reason why not
Avatar
mh, @heinrich5991 do you know any fs with good cross platform support?
Avatar
any good fs? ^^
11:14
fat32 has very good cross platform support
11:14
dunno about exfat, maybe that?
Avatar
Avatar
heinrich5991
any good fs? ^^
yes ๐Ÿ˜„
11:14
Exfat uses linked lists, it's absolutely awful for lookups
Avatar
what does cross-platform mean for you? windows/linux? or windows/macos/linux?
11:15
perhaps even ntfs?
Avatar
windows/macos/linux is preferable but I'm okay with macos/linux
11:15
maybe zfs has a macOS port, it's born in bsd too
Avatar
it does, I think
11:15
just windows has bad support
11:15
lemme google
Avatar
windows needs minimal support, if I can browse files and copy, files on windows that's a win, I'd mainly be using this on macOS and linux
11:17
Avatar
I guess zfs it is, ext4 on macOS is annoying af
Avatar
try it first!
11:17
before settling
Avatar
it will take me so long to copy these files off of the exfat partition ๐Ÿ˜ฆ
Avatar
@Learath2 if its not too much of a hassle, could you build the twmap binaries from source (master branch)?
11:21
I want to get a fix in but I don't want to spam versions
Avatar
awesome :)
Avatar
I'm trying to decide whether to upgrade to Big Sur or not
11:28
exfat partitions can't be resized....
11:29
@Patiga updated to master
Avatar
I was playing, for some reason I had communication problems for a couple of seconds, I re-logged in, continued playing and noticed that I couldn't update the servers, launched a parallel client - everything works. !masterbug
Avatar
@Patiga u know u can add -alpha.0
13:28
-alpha.1
13:28
-beta.0
13:28
for versions you dont think are ready
13:28
on cargo
13:28
they will be marked as pre released
13:29
and wont show up by default
Avatar
ah I didn't know that, interesting
13:30
example
Avatar
although my problem isn't that I don't think that those versions are incomplete, its just that I don't see the point in spamming them
Avatar
i think if u have a fix and itsi mportant it should be released tho
Avatar
eh I don't think anyone except for the ddnet bot is using that right now, and its not improbable that I need to do another small fix again in the next few days
Avatar
but yeah, if it was used more a quick release would be good
Avatar
@heinrich5991 for some reason libtw2 doesn't expose server_version in th files
Avatar
Avatar
Learath2
Q: Does anyone know whether I can create a ext4 filesystem inside a file?
https://github.com/e2tools/e2tools has some userspace programs to interact with ext2/ext3 filesystems in files
A simple set of GPL'ed utilities to read, write, and manipulate files in an ext2/ext3 filesystem. - GitHub - e2tools/e2tools: A simple set of GPL'ed utilities to read, write, and ma...
15:15
but ofc you can also mkfs or mount any file just like you do /dev/sd?? nodes
Avatar
someone knows a good name for a "CMS" focused on blogging (and not a static generator) made in rust
16:08
project
Avatar
SentencePress Kapp (edited)
Avatar
Static content Rust element extention Network yielder
Avatar
Request: Editor feature that allows to duplicate existing layers but not what is mapped in them just the layer values
Avatar
secure password hashing monkaS
Avatar
oh brand-new(tm) hashing algo xd
Avatar
@gerdoe from 2015
Avatar
chillerdragon BOT 2021-07-27 17:33:22Z
@Ryozuki: for wat u code pw hashing in rust?
Avatar
u should use it
17:33
whenever u can
Avatar
Avatar
Ryozuki
@gerdoe from 2015
do you know any better and newer algo xd
17:34
argon2 is the best
17:34
maybe nsa has something hidden
Avatar
that's why i called it brand-new
Avatar
argon2 is brand new
17:34
by crypto standards
Avatar
chillerdragon BOT 2021-07-27 17:35:53Z
?
@Ryozuki: for wat u code pw hashing in rust?
Avatar
@ChillerDragon do u see why i asked a name for a cms earlier
17:36
xd
17:36
im coding it rn
Avatar
chillerdragon BOT 2021-07-27 17:36:52Z
watrs a cms
Avatar
Avatar
Ryozuki
someone knows a good name for a "CMS" focused on blogging (and not a static generator) made in rust
monkalaugh
17:37
content management system
17:37
the most famous is wordpress
17:37
im making my own in rust
Avatar
chillerdragon BOT 2021-07-27 17:37:09Z
content management system
17:37
ah sure
17:37
i was about to say use wordpress xd
Avatar
rustpress ftw
17:38
image.png
17:38
lol
Avatar
chillerdragon BOT 2021-07-27 17:39:13Z
its fake domain!
17:39
u scammer?
Avatar
chillerdragon BOT 2021-07-27 17:40:10Z
Ryo = indian tech support
Avatar
lol no
17:41
ryo = pro based rust programmer
17:41
greenthing
Avatar
I have found another thing that needs immediate attention in rust
Avatar
@heinrich5991 when we are using net_addr_from_str(...) for ipv4 parsing, should we set addr->port = 0 when no port is given?
Avatar
The Read trait needs a bit of a redesign to expose whether it's buffered and needs a way to read into uninitialized buffers while at it
Avatar
chillerdragon BOT 2021-07-27 17:44:36Z
if u set port to 0 u get uid 0 and have a local root exploit over your NAT
Avatar
Avatar
Learath2
The Read trait needs a bit of a redesign to expose whether it's buffered and needs a way to read into uninitialized buffers while at it
nothing can be uninit in rust
17:45
also its not buffeded unless u use bufwriter
17:45
bufreader
Avatar
Avatar
chillerdragon
if u set port to 0 u get uid 0 and have a local root exploit over your NAT
same with ipv6 right?
Avatar
Yes einstein. Thus I said it needs attention :D
Avatar
no its perfect
Avatar
You are so drunk on koolaid :D
17:46
im messing with u
17:46
but i dont see anything wrong rn tbh
17:46
i know when im using a bufwriter
Avatar
A wrapper type to construct uninitialized instances of T.
17:46
omg chillerdragon
17:46
ur video embed is too big
Avatar
chillerdragon BOT 2021-07-27 17:47:00Z
axaxaxax
Avatar
If you can't know whether something implementing Read is buffered. So your apis performance characteristics vary widely
Avatar
@Learath2
17:47
!!!!!!
Avatar
chillerdragon BOT 2021-07-27 17:47:19Z
not only my video embed is big if you know what i mean ;)
Avatar
Avatar
Learath2
If you can't know whether something implementing Read is buffered. So your apis performance characteristics vary widely
how u cant know?
17:47
the idiom here is to just accept a object that has a Write impl
17:47
and user decided to use bufwrite
17:47
or
17:47
u can wrap it urself
17:47
u always know if its buffered
17:48
user can decide to use*
Avatar
Avatar
Ryozuki
@Learath2
The initialized thing heinrich already wrote a solution to and the std uses an adhoc variant of it. You can initialize the buffer as you go to preserve safety
Avatar
to this day i have yet to use unsafe
17:49
greenthing
Avatar
Avatar
Ryozuki
u always know if its buffered
You can always wrap, but then you need to accept double wrapping too, which increases overhead. serde_json is rolling an extra function to get around it
Avatar
use alkahest instead serde_json!11!
Avatar
Who is an alkahest?
Avatar
you can achieve zero copy json serialization with serde iirc
17:50
serde already is perfomant
Avatar
Xingese alkahestry to deserialize json?
17:51
i guess he means this
17:51
Key differences of Alkahest from other popular serialization crates is zero-overhead serialization and zero-copy lazy deserialization.
Avatar
Avatar
Ryozuki
serde already is perfomant
Heh, check out how the buffered reader issue makes serde json 10 times slower than pythons shitty json lib :D
Avatar
sources?
Avatar
It's an edge case. If you load the file entirely first it faaar outperforms python
17:53
It takes 750 ms to deserialize these types while json.load in python takes 300 ms. Reported by @mitsuhiko in IRC.
17:53
Maybe specializations will get stable some day, that'd help this too
Avatar
btw serde_json::from_str is the one u will end up using most
17:54
specially in web apps
17:54
iirc
Avatar
And rust#78485 is the uninit thing I mentioned. I used heinrichs nice wrapper for now
Avatar
im 2 lazy to check
17:55
if u dont give a link
17:55
greenthing
Avatar
kill the embeds
17:55
xd
Avatar
This is a tracking issue for the RFC "2930" (rust-lang/rfcs#2930). The feature gate for the issue is #![feature(read_buf)]. About tracking issues Tracking issues are used to recor...
Avatar
considering the amount of features serde has
17:56
and how general it is
17:56
its impressive its this fast
17:56
its some black magic
Avatar
Macromagix and some very tight optimization to limit the amount of llvm ir emited to begin with
Avatar
The current design of the Read trait is nonoptimal as it requires that the buffer passed to its various methods be pre-initialized even though the contents will be immediately overwritten. This RFC proposes an interface to allow implementors and consumers of Read types to robustly and soundly work with uninitialized buffers.
17:57
ok i agree
17:57
i hope they implement something
17:58
good thing about rust being a community
Avatar
I browsed around it serde source a bit today. Learned some very nice rust trixx
Avatar
i should too
17:58
but im 2 lazy
17:58
its true when u work coding u lose some passion to do it in free time
17:58
but i still code rust
17:58
feelsbadman
Avatar
Avatar
gerdoe
oh lol he didn't insert his own crate as benchmark object
lmao
Avatar
actually he sent me results (edited)
17:59
xd
17:59
so thought it's here
Avatar
monkaS not enough tabs
18:00
@Learath2 cool post about the future rust features
Avatar
tabs gang xd
18:00
2 small
18:00
press ctrl-w
Avatar
15 damn hours I ran rsync and it's not even close to being done with copying
19:37
GOD
Avatar
are they not SSDs?
Avatar
No it's not even the drives speed that's the issue...
19:38
it's exfat
19:38
kek
19:38
kinda funny how for a while that was the flash drive standard
19:38
or was
19:39
and it's just painfully slow
Avatar
I think I'll just download it again, there is no way this copy from disk to disk will end
19:39
nor is there anyway I can copy it back
Avatar
doesn't btrfs also suck tho
19:39
is ext4 king
Avatar
don't say anything about btrfs, sounds like something @Ryozuki would like
Avatar
Avatar
Learath2
don't say anything about btrfs, sounds like something @Ryozuki would like
i heard its not as mature, i just used it once to have a shared folder with windows
19:41
i didnt want to use a propietary format like ntfs
19:41
hail stallman
Avatar
i think it has security/stability issues last i checked
19:42
but maybe it's better now
Avatar
ext4 isnt perfect either
19:43
filesystems are hard
Avatar
I'm this close to just keeping a chart of offsets on the wall and writing to the disk raw
Avatar
how large is it
Avatar
@Learath2 exfat uses linked lists right?
19:45
so btrfs uses b trees
Avatar
reading some kernel lore i read stuff like red black tree
19:46
gotta figure out what it is
19:47
must be this
19:47
In computer science, a redโ€“black tree is a kind of self-balancing binary search tree. Each node stores an extra bit representing "color" ("red" or "black"), used to ensure that the tree remains balanced during insertions and deletions
19:47
fancy names
Avatar
yea red-black trees are cool
19:49
im a sucker for anything strictly efficient but annoying to implement
19:50
i think we learned to do red-black trees on paper in college
19:50
but i have no idea how now lol
Avatar
i always get the urge to impl these kind of stuff but rust is nto friendly for this
19:50
and i dont want to touch c right now
Avatar
all languages suck
19:51
use zig/nim
19:52
rust is the best
19:53
19:53
greenthing
Avatar
bar to entry is too high, and im not even sure it's entirely worthwhile when competing languages have improved safety/correctness alongside it
19:56
still, rust is the best for what it set out to achieve, but i think if you're working on a project that requires people with a general CS background, it makes sense to use something else
19:56
my opinion will probably change a bit when i learn rust, but i doubt it will be by much
Avatar
Avatar
lynn
bar to entry is too high, and im not even sure it's entirely worthwhile when competing languages have improved safety/correctness alongside it
which
Avatar
Avatar
lynn
still, rust is the best for what it set out to achieve, but i think if you're working on a project that requires people with a general CS background, it makes sense to use something else
lol i think ppl with a general cs background fit even more
19:58
i didnt like rust the first time i tried it, some months passed and i tried it again
19:58
i got hooked
Avatar
Avatar
Ryozuki
which
i actually might be wrong about this, my impression was that nim and zig had some safety improvements but i find nothing about safety specifically when i search for it
Avatar
if u tried c++
20:00
u should learn rust
20:01
u will know why ppl love it
Avatar
i dont know either lol
Avatar
my background is java, python, js, php, lua
Avatar
the thing about rust is that it provides safety while having c++ speed
Avatar
eh python first
Avatar
and then it's in order
Avatar
they say programmers mature towards static languages
Avatar
i mean tons of languages have c speed nowadays.
Avatar
saying "use rust" because c speed is silly
20:02
crystal, nim, zig
Avatar
use rust cuz its safe
Avatar
right yea
20:02
but im just saying
Avatar
if u dont use unsafe and do a program in rust it wont crash
Avatar
speed is no longer really an issue
Avatar
u can also have thread safety
Avatar
tons of compiled langs now that outperform c even
Avatar
and the type system is amazing
Avatar
Avatar
lynn
tons of compiled langs now that outperform c even
? which
20:02
thats not true
20:03
most compiled langs use gc
Avatar
in like 5 years people will be like why do we hold c to be the gold standard
Avatar
NickFearlespTR 2021-07-27 20:03:06Z
hi I have a question Who can look private
Avatar
anyway i gotta focus on my dota ranked
20:03
brb
Avatar
i gotta get back to work but i saw some benchmarks that showed crystal was really fast
20:05
also if you want a technical, totally not practical case, for numeric/array computations fortran is still better than c
Avatar
Avatar
lynn
how large is it
One of the linked lists is 64 megabytes now
20:17
writing a new file takes about a minute to traverse down
Avatar
just 1.5 million files to kill exfat
20:20
I'm like so close to just deleting the entire thing
Avatar
i would not hold it against you
20:21
what data is on it?
Avatar
the first 3 years of teehistorian
Avatar
.......ehhhhhhh xD
20:21
who knows if it will be useful
Avatar
deen and heinrich also have copies, so it wouldn't be gone either, but at this point I wasted 3 days messing around with this and am annoyed
justatest 1
Avatar
are you on vacation currently?
Avatar
I'm about to go on one and if I don't archive some files before I go my server will be very sad
20:25
no disk space = no good
20:26
I wrote 3 tools to parse and collect information about files inside exfat directories, so there is that
Avatar
c-enum is pain wooaah
21:44
literally thought about splitting enums in mapitems.h
21:44
and now stuck on validating enums
Exported 310 message(s)