Thursday, 30 June 2022

New top story on Hacker News: Ask HN: Forensic analysis for 50 yr old tape

Ask HN: Forensic analysis for 50 yr old tape
8 by passer_byer | 8 comments on Hacker News.
Im posting for a friend who moved recently. He found a magnetic tape that was written over 50 years ago. He says, if he recalls correctly, the tape would have contained 2 file, EBCDIC encoded, written by an IBM utility using a tape sub-system attached to a s/360 processor running MVS. Assume the IBM guys have this setup in some dusty basement in upstate New York. This is a 2 part question. What is the best method for attempting to read this mag tape? That’s the main question. Second, what is the probability of success here? Assume the tape was kept in a climate controlled home.

On the Sonoma Coast, Fog, Wind and Exceptional Wine


By BY ERIC ASIMOV from NYT Food https://ift.tt/eWhM0JZ

Wednesday, 29 June 2022

New top story on Hacker News: Show HN: Ploomber Cloud (YC W22) – run notebooks at scale without infrastructure

Show HN: Ploomber Cloud (YC W22) – run notebooks at scale without infrastructure
25 by idomi | 3 comments on Hacker News.
Hi, we’re Ido & Eduardo, the founders of Ploomber. We’re launching Ploomber Cloud today, a service that allows data scientists to scale their work from their laptops to the cloud. Our open-source users ( https://ift.tt/e41nP5I ) usually start their work on their laptops; however, often, their local environment falls short, and they need more resources. Typical use cases run out of memory or optimize models to squeeze out the best performance. Ploomber Cloud eases this transition by allowing users to quickly move their existing projects into the cloud without extra configurations. Furthermore, users can request custom resources for specific tasks (vCPUs, GPUs, RAM). Both of us experienced this challenge firsthand. Analysis usually starts in a local notebook or script, and whenever we wanted to run our code on a larger infrastructure we had to refactor the code (i.e. rewrite our notebooks using Kubeflow’s SDK) and add a bunch of cloud configurations. Ploomber Cloud is a lot simpler, if your notebook or script runs locally, you can run it in the cloud with no code changes and no extra configuration. Furthermore, you can go back and forth between your local/interactive environment and the cloud. We built Ploomber Cloud on top of AWS. Users only need to declare their dependencies via a requirements.txt file, and Ploomber Cloud will take care of making the Docker image and storing it on ECR. Part of this implementation is open-source and available at: https://ift.tt/Ruo3aZV Once the Docker image is ready, we spin up EC2 instances to run the user’s pipeline distributively (for example, to run hundreds of ML experiments in parallel) and store the results in S3. Users can monitor execution through the logs and download artifacts. If source code hasn’t changed for a given pipeline task, we use cached artifacts and skip redundant computations, severely cutting each run's cost, especially for pipelines that require GPUs. Users can sign up to Ploomber Cloud for free and get started quickly. We made a significant effort to simplify the experience ( https://ift.tt/1rBgjO4 ). There are three plans ( https://ift.tt/nA8DlhB ): the first is the Community plan, which is free with limited computing. The Teams plan has a flat $50 monthly and usage-based billing, and the Enterprise plan includes SLAs and custom pricing. We’re thrilled to share Ploomber Cloud with you! So if you’re a data scientist who has experienced these endless cycles of getting a machine and going through an ops team, an ML engineer who helps data scientists scale their work, or you have any feedback, please share your thoughts! We love discussing these problems since exchanging ideas sparks exciting discussions and brings our attention to issues we haven’t considered before! You may also reach out to me at ido@ploomber.io.

20 Men Convicted in November 2015 Paris Terrorist Attack


By BY CONSTANT MÉHEUT AND AURELIEN BREEDEN from NYT World https://ift.tt/9duwF0r

Alex Murdaugh charged in money laundering and drug scheme



from Yahoo News - Latest News & Headlines https://ift.tt/NYvbEpB

Removed South Dakota AG presses ethics case against Noem



from Yahoo News - Latest News & Headlines https://ift.tt/cF2mgNk

Sunday, 26 June 2022

‘Bodies They Ritual’ Review: Plush Robes and Cults


By BY ELISABETH VINCENTELLI from NYT Theater https://ift.tt/I6mgDOZ

Grand Canyon won't seek volunteers to kill bison this fall



from Yahoo News - Latest News & Headlines https://ift.tt/1YBfyku

Saturday, 25 June 2022

A Year Away, a New Coach and the Same Goal: Winning Wimbledon


By BY CHRISTOPHER CLAREY from NYT Sports https://ift.tt/S9R4hqP

Congress Clears Bill to Extend Free Meals for Children Through the Summer


By BY STEPHANIE LAI AND LINDA QIU from NYT U.S. https://ift.tt/jZPauLA

‘Vedette’ Review: A Cow’s Trouble in Paradise


By BY MANOHLA DARGIS from NYT Movies https://ift.tt/hVb0U1P

When, Exactly, Did Mount Vesuvius Erupt?


By BY ELISABETTA POVOLEDO from NYT World https://ift.tt/fMYKeSm

NY gov, mayor, blast SCOTUS gun decision



from Yahoo News - Latest News & Headlines https://ift.tt/eJ8yksH

Wednesday, 22 June 2022

New top story on Hacker News: Show HN: Data Diff – compare tables of any size across databases

Show HN: Data Diff – compare tables of any size across databases
38 by hichkaker | 0 comments on Hacker News.
Gleb, Alex, Erez and Simon here – we are building an open-source tool for comparing data within and across databases at any scale. The repo is at https://ift.tt/6njJSor , and our home page is https://datafold.com/ . As a company, Datafold builds tools for data engineers to automate the most tedious and error-prone tasks falling through the cracks of the modern data stack, such as data testing and lineage. We launched two years ago with a tool for regression-testing changes to ETL code https://ift.tt/xV5QPkt . It compares the produced data before and after the code change and shows the impact on values, aggregate metrics, and downstream data applications. While working with many customers on improving their data engineering experience, we kept hearing that they needed to diff their data across databases to validate data replication between systems. There were 3 main use cases for such replication: (1) To perform analytics on transactional data in an OLAP engine (e.g. PostgreSQL > Snowflake) (2) To migrate between transactional stores (e.g. MySQL > PostgreSQL) (3) To leverage data in a specialized engine (e.g. PostgreSQL > ElasticSearch). Despite multiple vendors (e.g., Fivetran, Stitch) and open-source products (Airbyte, Debezium) solving data replication, there was no tooling for validating the correctness of such replication. When we researched how teams were going about this, we found that most have been either: Running manual checks: e.g., starting with COUNT(*) and then digging into the discrepancies, which often took hours to pinpoint the inconsistencies. Using distributed MPP engines such as Spark or Trino to download the complete datasets from both databases and then comparing them in memory – an expensive process requiring complex infrastructure. Our users wanted a tool that could: (1) Compare datasets quickly (seconds/minutes) at a large (millions/billions of rows) scale across different databases (2) Have minimal network IO and database workload overhead. (3) Provide straightforward output: basic stats and what rows are different. (4) Be embedded into a data orchestrator such as Airflow to run right after the replication process. So we built Data Diff as an open-source package available through pip. Data Diff can be run in a CLI or wrapped into any data orchestrator such as Airflow, Dagster, etc. To solve for speed at scale with minimal overhead, Data Diff relies on checksumming the data in both databases and uses binary search to identify diverging records. That way, it can compare arbitrarily large datasets in logarithmic time and IO – only transferring a tiny fraction of the data over the network. For example, it can diff tables with 25M rows in ~10s and 1B+ rows in ~5m across two physically separate PostgreSQL databases while running on a typical laptop. We've launched this tool under the MIT license so that any developer can use it, and to encourage contributions of other database connectors. We didn't want to charge engineers for such a fundamental use case. We make money by charging a license fee for advanced solutions such as column-level data lineage, CI workflow automation, and ML-powered alerts.

President Joe Biden calls for federal gas tax holiday despite pushback



from Yahoo News - Latest News & Headlines https://ift.tt/tKISWhJ

Fiery crash landing at Miami airport captured on video



from Yahoo News - Latest News & Headlines https://ift.tt/149YlqJ

What people are saying about the chance of a U.S. recession.


By BY ISABELLA SIMONETTI from NYT Business https://ift.tt/VlRxk0i

Taxi Jumps Curb, Critically Injuring 3 Pedestrians in Manhattan


By BY NICOLE HONG AND ALI WATKINS from NYT New York https://ift.tt/c9xEPnA

5 British Men Released by Taliban as U.K. Expresses Regret


By BY DAVID ZUCCHINO AND CARLOTTA GALL from NYT World https://ift.tt/vb3a97t

College basketball star killed, 8 wounded in NYC shooting



from Yahoo News - Latest News & Headlines https://ift.tt/GMEcYl5

Can These Movies Save the Movies?


By BY ROSS DOUTHAT from NYT Opinion https://ift.tt/40jPaqU

Friday, 17 June 2022

Thursday, 16 June 2022


By BY THE NEW YORK TIMES from NYT U.S. https://ift.tt/vI9U74o

Backpackers stranded after historic flooding in Montana



from Yahoo News - Latest News & Headlines https://ift.tt/LCVAOdB

New top story on Hacker News: Are V8 isolates the future of computing?

Are V8 isolates the future of computing?
12 by pranay01 | 4 comments on Hacker News.
I was reading this article on Cloudflare workers https://ift.tt/1zxDvup and seemed like isolates have significant advantage over serverless technology like lambda etc. What are the downsides of v8? Is it poor security isolation?

Tuesday, 14 June 2022

‘Lightyear’ Review: Infinite Buzz


By BY A.O. SCOTT from NYT Movies https://ift.tt/fVbeMpL

Adams Announces Plan to Fix New York City’s Growing Housing Crisis


By BY MATTHEW HAAG, DANA RUBINSTEIN AND ANDY NEWMAN from NYT New York https://ift.tt/9R03mFx

They Know Every Page of ‘The Book of Mormon’


By BY MATT STEVENS from NYT Theater https://ift.tt/MC8Pi1T

Pro-Trump Candidate Calls for Executing Parents of LGBTQ+ Kids



from Yahoo News - Latest News & Headlines https://ift.tt/PAU8SyT

Courses at Horses


By Unknown Author from NYT Food https://ift.tt/I8vcjB5

Saturday, 11 June 2022

Why the Memory of Jan. 6 Can’t Prevent a Trump Resurgence


By BY ROSS DOUTHAT from NYT Opinion https://ift.tt/ReZt3B1

If You Must Point Fingers on Inflation, Here’s Where to Point Them


By BY CHRISTOPHER LEONARD from NYT Opinion https://ift.tt/7X8xtLq

Dad surprises his visually impaired son at school



from Yahoo News - Latest News & Headlines https://ift.tt/Ebker1K

As the Russians close in, civilians in Lysychansk must decide whether to stay or go.


By BY NATALIA YERMAK, THOMAS GIBBONS-NEFF AND TYLER HICKS from NYT World https://ift.tt/3GCLsfY

Friday, 10 June 2022

New top story on Hacker News: Google does not list application permissions in the Play Store any more

Google does not list application permissions in the Play Store any more
46 by datalist | 10 comments on Hacker News.
https://ift.tt/BADRKyG They had implemented that already a while ago, then reverted the behaviour, and now implemented it once again. It seems as if it was not "enabled" for everyone yet, however. They hid the permissions with each version better and better and apparently decided now, users don't need them at all.

7 items to never bring to the beach



from Yahoo News - Latest News & Headlines https://ift.tt/bvZNAsf

Thursday, 9 June 2022

Rebel Wilson Comes Out, Shares Adorable Photo With New Girlfriend



from Yahoo News - Latest News & Headlines https://ift.tt/K4X7SIt

5 killed by Texas escapee died from gunshots, stab wounds



from Yahoo News - Latest News & Headlines https://ift.tt/EA3O0Tl

Wednesday, 8 June 2022

The Roots of Black Pain in America


By BY KAITLYN GREENIDGE from NYT Books https://ift.tt/H7g9Gky

Tuesday, 7 June 2022

Taiwanese F-16 fighter makes emergency landing in Hawaii



from Yahoo News - Latest News & Headlines https://ift.tt/zbK59DQ

2nd mistrial declared in Indiana case of slain pastor's wife



from Yahoo News - Latest News & Headlines https://ift.tt/V0KRsW2

Monday, 6 June 2022

Guerrilla Attacks Signal Rising Resistance to Russian Occupation



from Yahoo News - Latest News & Headlines https://ift.tt/B7TJonr

Sunday, 5 June 2022

Online pro-gun extremism: 'Cool for active shooter stuff'



from Yahoo News - Latest News & Headlines https://ift.tt/3LfcjqG

Saturday, 4 June 2022

Liz Cheney on the GOP's "cult of personality" around Trump



from Yahoo News - Latest News & Headlines https://ift.tt/UX8V0wM

Friday, 3 June 2022

Wonking Out: How Low Must Inflation Go?


By BY PAUL KRUGMAN from NYT Opinion https://ift.tt/5iqAkSf

Weekly Health Quiz: Anxiety, Coffee and Contrast Dyes


By BY KNVUL SHEIKH from NYT Well https://ift.tt/DC0nJNQ

Former Qatar princess found dead at home in southern Spain



from Yahoo News - Latest News & Headlines https://ift.tt/XYnjws2

California to unveil groundbreaking slave reparations report



from Yahoo News - Latest News & Headlines https://ift.tt/xTnPXGa