A different kind of programming workflow paradigm

The main issue I have with this is the exclusive focus on happy path. The point of unit tests and especially mutation testing is to validate that every code path has a defined test and hence defined behavior. I wouldn't want to give that up, myself. I'm a huge believer in type safety and immutable objects and other things that prevent architectural misuse.

This is what Smalltalk is all about, and it has been like that since it’s origin: you basically program in the debugger, you program running, you change something, you proceed the debugger, etc. That’s why technics like TDD, refactoring, and others were developed in Smalltalk and just later translated to other languages (and always lacking, since no one reproduces the live programming experience 100%). As the time passed, attention has moved to other languages and most people not ignores what it was to program like that. But there are still some implementations around: I work with Pharo (https://pharo.org), and I can to say is all what you ask for in this post :)

Compose and flutter both have "realtime" previews? And I believe react has something similar? They aren't truely realtime, because usually there is a compile/execute step happening, but they can be fairly good for rapid feedback?

https://docs.flutter.dev/tools/hot-reload

https://blaszcz.uk/live-reload-with-compose-web/

For unit tests, there is https://infinitest.github.io/, which automatically updates your tests as you code. Never used it though.

I'm not sure that what developers really, really need is faster programming cycles. Most teams could benefit more by controlling the process - from idea to deployed. How much technical debt is incurred because users/customers can't prioritize features or give accurate requirements, there's way too much WIP, features are huge, releases are huge and infrequent and the feedback cycles are far too long.

So yeah, as programmers it's always cool to look at ways to program faster, but what's the point in programming stuff nobody needs faster? Or programming the wrong things faster?

I'd be willing to be that if you asked any team, "What are the biggest impediments to delivering value to your users faster?", the answer would be that you can't cut code fast enough.

IMO Clojure really shines with a REPL-driven development, where you have a REPL to interact with a live running application. You can have a very productive workflow where you conduct little code experiments and incrementally build up functionality. Typically, in this workflow, you're also sending code (as S-expression forms) to the REPL from your editor to inspect or test the output (some tools have inline display of the output like the Calva Clojure extension for VS Code ). Any tests you come up with in the REPL can usually be turned into unit tests fairly easily (e.g. copy/paste into a tests file) and those tests can be run automatically on source change in the background as well or from the REPL itself. There are also tools on built on top of the REPL that can be used for live inspection of data structures, data visualization/exploration, creating watches on variables, etc. Although the Clojure REPL is best used when developing Clojure applications, I've also found it useful for getting familiar with Java apps such as a complex Spring Framework web app that I had to work on.

For Python, I typically use Jupyter/IPython to hash out and test the functionality I need and I find provides a much superior experience to just using the regular $ python REPL. With PyCharm, the Jupyter integration is really nice and makes the experience a lot more liquid than having to flip between a browser tab and your editor. It's not quite as nice as a REPL integrated with your live running app, but I personally find it more productive than running a debugger or just spamming print statements and modifying and rerunning my Python script 100X.

I really hope that more languages start to better support for more exploratory, experimental development workflows since sometimes I just want to play around to get familiar with using a library or tool in a sandbox. I think there's a lot of room to improve developer productivity through blending and integrating together REPLs, notebook-like environments, hot code reloading and other tools/techniques to enable rapid prototyping and faster feedback for developers. Tests and type checking are very useful when you've figured out what you need and need to have sanity checks, but can be a major hindrance in that "figuring it out" exploratory stage.

I can imagine there would be challenges with parsing/evaluating incomplete code syntax and functions. So I guess, the whole compiler/translator side has to be thought out from the ground up as well.

What I always found kind of strange in this regard, is that many of the scripting languages (Python, JS etc.), which are good for this workflow, decided to be extremely loose on the syntax front.

Compilers love semicolons and scope braces, because whenever you encounter one, you know what you just parsed is supposed compile. And if it doesn't compile, you can easily narrow down that location and still reason about the rest.

In a REPL, you could potentially tell the user that you don't yet know what velocity is, because that doesn't compile, but the result of the remaining calculations is going to be 6.28 * velocity.

Permanently Deleted

Huh... I've used Guard and TDD to do this in Ruby, works great. Yes you're testing the happy path, but it is easy to define negative tests as well.

Thank you for raising the question. I think it's an important one to think about. I constantly hear about good things about the REPL experience of LISP family languages. You can set up a code fragment (the test in your example) to run constantly in the background as you edit. Then you can jump to the REPL anytime and interact with the state.

I myself am more on the ML-family side of FP, where you'd encode the expected behavior with an expressive type system and work with the type checker (the smart compiler) to implement that behavior.

One important thing to note is that the type checking process is also a fast feedback loop. The difference is that it's often on the abstract level and you're more concerned about the expected behavior instead of the actual behavior.

It's harder to write, but the advantage is that you'll have more confidence once it type checks.

Of course, the two styles are not mutual exclusive, just that the tooling ecosystem will often reflect the culture of that language family. And it's easier to add a simple watch make task, but harder to go the other way around.

What you're saying reminds me a lot of a talk I listened to some time ago, https://www.youtube.com/watch?v=8Ab3ArE8W3s. If you can spare 45 minutes, it's a really good listen. Particularly the debugging section should be interesting for you, but I'm not sure I'd recommend skipping ahead.

The talk is more on a conceptual level but there are some really good concrete examples near the end. Maybe listening can give you a good starting point on what to look for.

Something like this? https://codepen.io/darrengriffith/pen/KpKxqR

I can edit the code and see the changes without rewhatevering.

I think of this as interactive development, or repl-driven development. You can work this way today in Clojure (frontend, backend, and lately even for scripting via babashka), and with lisps in general - the syntax lends itself to sending expressions to the repl and returning values to your editor.

It’s really the best way (my favorite, at least) to program that i’ve found for exactly the reasons you mentioned - it’s excellent for debugging and ensuring the behavior of small functions with minimal overhead.

Types are frustrating because they lock things up and they don’t guarantee behavior, which is really all a program cares about. I feel similarly about unit tests… it’s extra code locking up your behaviors, so make sure they’re what you actually want! A general problem with types is that you have to commit to some shape early, which can lead to premature design and basically some arbitrary DSL when you just needed a couple functions/transformations. Feels like the problem of OO at times.

On the other side, the trouble (beyond people generally not wanting to read/learn lisps, which is unfortunate) is that repl-driven dev requires that you take care of your tools, which means there’s a tough learning curve and then some maintenance cost for whatever editor you want to use.

At a career-level scale, in my opinion, the investment is well worth it, but it’s a tough thing to figure out early in your career. I expect most devs with a couple years of js/python see types and feel like it’s a huge relief, which is real, and maybe types make sense at a certain team size…

I think people should spend time in several different languages and paradigms - it makes the ones you go back to make more sense :D

At one point I was working in python and made a 30 line script to run tests automatically on file change.

Then if it a test starts failing then I would play one sound once.

Then when fixed I played another sound.

The feedback was both lightning fast and didn't require leaving the code.

You can still have it as long as your tests run fast.