Logs: freenode/#haskell
| 2021-03-25 19:53:06 | <tomsmeding> | it looks like it's making lots of network requests and setting up a new tcp connection for each one |
| 2021-03-25 19:53:40 | <tomsmeding> | ah and the IP is the one of haskellstack.com |
| 2021-03-25 19:54:08 | Chousuke_ | is now known as Chousuke |
| 2021-03-25 19:54:39 | Guest69019 | is now known as mozzarella |
| 2021-03-25 19:55:08 | mozzarella | is now known as Guest98327 |
| 2021-03-25 19:55:21 | × | nff quits (~IceChat95@62-11-94-44.dialup.tiscali.it) (Quit: If at first you don't succeed, skydiving is not for you.) |
| 2021-03-25 19:57:50 | → | m1dnight_ joins (~m1dnight@188.ip-51-91-158.eu) |
| 2021-03-25 19:58:30 | × | conal quits (~conal@192.145.118.251) (Quit: Computer has gone to sleep.) |
| 2021-03-25 19:58:53 | → | myShoggoth joins (~myShoggot@75.164.81.55) |
| 2021-03-25 19:59:12 | <myShoggoth> | About to continue reading the garbage collector code: https://www.twitch.tv/myshoggoth |
| 2021-03-25 19:59:31 | <remedan> | tomsmeding: according to nethogs stack is continually receiving some small KB/s of data |
| 2021-03-25 19:59:33 | → | conal joins (~conal@192.145.118.251) |
| 2021-03-25 20:00:09 | × | ukari quits (~ukari@unaffiliated/ukari) (Remote host closed the connection) |
| 2021-03-25 20:00:31 | → | ukari joins (~ukari@unaffiliated/ukari) |
| 2021-03-25 20:00:32 | <remedan> | could it be a network issue? |
| 2021-03-25 20:01:29 | <remedan> | is stack supposed to download something during this step? |
| 2021-03-25 20:01:32 | <tomsmeding> | remedan: I think it's just inefficient code :p |
| 2021-03-25 20:01:37 | <remedan> | :D |
| 2021-03-25 20:01:59 | <tomsmeding> | I suspect it's downloading metadata for each package, separately -- though that's a guess |
| 2021-03-25 20:02:32 | tomsmeding | is spitting through stack's source code but I'm not seeing it doing network requests yet (the log is here https://github.com/commercialhaskell/pantry/blob/master/src/Pantry.hs#L1825 ) |
| 2021-03-25 20:03:38 | × | conal quits (~conal@192.145.118.251) (Ping timeout: 240 seconds) |
| 2021-03-25 20:03:47 | <remedan> | iotop also shows some tiny writes to hdd |
| 2021-03-25 20:04:11 | <tomsmeding> | yeah it's writing to pantry.sqlite3 after each network request |
| 2021-03-25 20:04:15 | → | stree joins (~stree@68.36.8.116) |
| 2021-03-25 20:05:47 | × | Chai-T-Rex quits (~ChaiTRex@gateway/tor-sasl/chaitrex) (Remote host closed the connection) |
| 2021-03-25 20:06:06 | × | Lord_of_Life quits (~Lord@unaffiliated/lord-of-life/x-0885362) (Ping timeout: 240 seconds) |
| 2021-03-25 20:06:07 | × | spoonm quits (~spoonm@tokyo.spoonm.org) (Quit: Don't look behind you!) |
| 2021-03-25 20:06:24 | → | Chai-T-Rex joins (~ChaiTRex@gateway/tor-sasl/chaitrex) |
| 2021-03-25 20:06:51 | → | spoonm joins (~spoonm@tokyo.spoonm.org) |
| 2021-03-25 20:06:52 | → | electricityZZZZ joins (~electrici@135-180-3-82.static.sonic.net) |
| 2021-03-25 20:07:13 | <remedan> | i just ran stack with -v and it's actually doing stuff |
| 2021-03-25 20:07:33 | × | rj quits (~x@gateway/tor-sasl/rj) (Ping timeout: 240 seconds) |
| 2021-03-25 20:07:33 | <remedan> | lots of Parsing cabal file for... and Parsing cabal file for... |
| 2021-03-25 20:07:58 | <remedan> | Going through packages |
| 2021-03-25 20:08:02 | <remedan> | but very slowly |
| 2021-03-25 20:08:06 | → | petersen joins (~petersen@redhat/juhp) |
| 2021-03-25 20:09:30 | <remedan> | * and Pulled blob from Casa for... |
| 2021-03-25 20:10:35 | × | o1lo01ol1o quits (~o1lo01ol1@bl7-88-181.dsl.telepac.pt) (Remote host closed the connection) |
| 2021-03-25 20:10:55 | <tomsmeding> | remedan: you're smarter than me for doing -v; yeah that apparently |
| 2021-03-25 20:11:11 | × | wroathe quits (~wroathe@c-68-54-25-135.hsd1.mn.comcast.net) (Ping timeout: 240 seconds) |
| 2021-03-25 20:11:19 | <tomsmeding> | the things it stores in the database are indeed cabal files btw |
| 2021-03-25 20:12:51 | → | rj joins (~x@gateway/tor-sasl/rj) |
| 2021-03-25 20:13:14 | <remedan> | and cabal files are just metadata? |
| 2021-03-25 20:13:24 | <tomsmeding> | remedan: they're package descriptions |
| 2021-03-25 20:13:56 | → | o1lo01ol1o joins (~o1lo01ol1@bl7-88-181.dsl.telepac.pt) |
| 2021-03-25 20:13:59 | × | aarvar quits (~foewfoiew@2601:602:a080:fa0:8d5e:8b07:4f7a:6938) (Ping timeout: 258 seconds) |
| 2021-03-25 20:14:14 | <tomsmeding> | which contain exposed module names, apparently to automatically determine which dependencies your script has based on its imports |
| 2021-03-25 20:14:23 | <tomsmeding> | or at least I think so |
| 2021-03-25 20:15:56 | <remedan> | it seems to be downloading hundreds of items at a rate of about 1 every 2 seconds |
| 2021-03-25 20:16:08 | <remedan> | my connection is otherwise fine |
| 2021-03-25 20:16:34 | × | o1lo01ol1o quits (~o1lo01ol1@bl7-88-181.dsl.telepac.pt) (Remote host closed the connection) |
| 2021-03-25 20:16:43 | <tomsmeding> | setting up an https connections takes a while (on the order of a second), and doing that again and again for each package instead of reusing the existing connection is I guess what's the problem here :p |
| 2021-03-25 20:17:11 | <remedan> | so is this like... the expected behavior? :D |
| 2021-03-25 20:17:36 | <tomsmeding> | seems so? |
| 2021-03-25 20:17:59 | <tomsmeding> | is there a person around in the channel with knowledge of stack's internals, by any chance? |
| 2021-03-25 20:18:13 | → | o1lo01ol1o joins (~o1lo01ol1@bl7-88-181.dsl.telepac.pt) |
| 2021-03-25 20:20:10 | × | o1lo01ol1o quits (~o1lo01ol1@bl7-88-181.dsl.telepac.pt) (Remote host closed the connection) |
| 2021-03-25 20:20:37 | → | star_cloud joins (~star_clou@ec2-34-220-44-120.us-west-2.compute.amazonaws.com) |
| 2021-03-25 20:21:47 | → | conal joins (~conal@64.71.133.70) |
| 2021-03-25 20:22:20 | → | Lord_of_Life joins (~Lord@unaffiliated/lord-of-life/x-0885362) |
| 2021-03-25 20:22:22 | × | merijn quits (~merijn@83-160-49-249.ip.xs4all.nl) (Ping timeout: 252 seconds) |
| 2021-03-25 20:22:52 | → | LiaoTao joins (~LiaoTao@gateway/tor-sasl/liaotao) |
| 2021-03-25 20:23:32 | × | conal quits (~conal@64.71.133.70) (Client Quit) |
| 2021-03-25 20:24:45 | <tomsmeding> | remedan: it terminated for me! |
| 2021-03-25 20:25:48 | <remedan> | tomsmeding: still going here but I didn't have it running the entire time |
| 2021-03-25 20:26:54 | <remedan> | what's the difference between stack script and stack runghc? |
| 2021-03-25 20:27:29 | <geekosaur> | stack script parses comments at the top of the file for things like extra package deps, iirc |
| 2021-03-25 20:28:30 | → | aarvar joins (~foewfoiew@2601:602:a080:fa0:e589:d5cd:80fb:258d) |
| 2021-03-25 20:29:13 | <remedan> | ah, all right |
| 2021-03-25 20:29:43 | × | raichoo quits (~raichoo@dslb-092-073-222-210.092.073.pools.vodafone-ip.de) (Quit: Lost terminal) |
| 2021-03-25 20:29:46 | → | o1lo01ol1o joins (~o1lo01ol1@bl7-88-181.dsl.telepac.pt) |
| 2021-03-25 20:29:49 | → | wroathe joins (~wroathe@c-68-54-25-135.hsd1.mn.comcast.net) |
| 2021-03-25 20:30:41 | × | o1lo01ol1o quits (~o1lo01ol1@bl7-88-181.dsl.telepac.pt) (Remote host closed the connection) |
| 2021-03-25 20:31:44 | → | heatsink joins (~heatsink@2600:1700:bef1:5e10:10c4:3f41:be04:1f78) |
| 2021-03-25 20:33:05 | → | o1lo01ol1o joins (~o1lo01ol1@bl7-88-181.dsl.telepac.pt) |
| 2021-03-25 20:34:38 | × | wroathe quits (~wroathe@c-68-54-25-135.hsd1.mn.comcast.net) (Ping timeout: 240 seconds) |
| 2021-03-25 20:36:13 | × | heatsink quits (~heatsink@2600:1700:bef1:5e10:10c4:3f41:be04:1f78) (Ping timeout: 258 seconds) |
| 2021-03-25 20:36:38 | × | elred_ quits (~elred_@82.102.19.142) (Ping timeout: 240 seconds) |
| 2021-03-25 20:37:01 | → | conal joins (~conal@64.71.133.70) |
| 2021-03-25 20:37:16 | × | conal quits (~conal@64.71.133.70) (Client Quit) |
| 2021-03-25 20:37:43 | <remedan> | seems kind of annoying that i can play with stack script just fine but the first time I import a built-in module I need to take a 30 minute break :D |
| 2021-03-25 20:37:54 | <remedan> | or at least execute the program differently |
| 2021-03-25 20:38:31 | <geekosaur> | especially since the imports are from base which shouldn't require any downloading at all |
| 2021-03-25 20:38:33 | <geekosaur> | IDEK |
| 2021-03-25 20:38:40 | → | conal joins (~conal@64.71.133.70) |
| 2021-03-25 20:38:41 | × | conal quits (~conal@64.71.133.70) (Client Quit) |
| 2021-03-25 20:38:50 | <tomsmeding> | it downloads the entire stackage LTS it seems |
| 2021-03-25 20:39:02 | <tomsmeding> | still digging for where exactly it performs the downloads |
| 2021-03-25 20:39:19 | <tomsmeding> | _everything_ performs IO in stack |
| 2021-03-25 20:39:55 | → | bollu joins (~bollu@139.59.46.74) |
| 2021-03-25 20:39:55 | <sm[m]> | remedan, stack runghc uses the current stack environment (your project or user package db) |
| 2021-03-25 20:40:48 | <sm[m]> | while stack script requires you to specify a resolver. Choose a resolver you already have mostly installed, to minimise the downloading it will do (and add --verbosity info to see more progress info) |
| 2021-03-25 20:41:39 | × | geekosaur quits (82650c7a@130.101.12.122) (Quit: Connection closed) |
| 2021-03-25 20:42:54 | <tomsmeding> | sm[m]: it's the individual downloading of cabal descriptions for auto-detecting package dependencies from imports that takes so long |
| 2021-03-25 20:43:28 | → | conal joins (~conal@64.71.133.70) |
| 2021-03-25 20:43:35 | <sm[m]> | oh ? interesting |
| 2021-03-25 20:43:38 | × | Lord_of_Life quits (~Lord@unaffiliated/lord-of-life/x-0885362) (Ping timeout: 252 seconds) |
| 2021-03-25 20:43:50 | <remedan> | sm[m]: stack script does more setting-up beforehand and then calls runghc? |
| 2021-03-25 20:44:11 | → | hexfive joins (~hexfive@50.35.83.177) |
| 2021-03-25 20:44:33 | <sm[m]> | remedan: not sure about that. If you look at the user guide you'll see.. script is designed to lock down deps exactly for maximum reproducibility |
All times are in UTC.