PRISM - a self-hosted OSINT platform with a real-time dashboard
from trulysoulless@lemmy.world to selfhosted@lemmy.world on 20 Jun 08:20
https://lemmy.world/post/48411926

I’ve been building PRISM - a self-hosted OSINT toolkit you run yourself instead of pasting investigation targets into someone else’s web service.

Give it a domain, IP, email, phone, or username and it runs 22+ modules in parallel into one dashboard: WHOIS, DNS, crt.sh subdomains, GeoIP, threat intel (Shodan/VirusTotal/AbuseIPDB/Censys), breach data, username search across 3000+ sites (Blackbird + Maigret), dark-web mirror checks, and more. Results come with an entity graph, a GeoIP map, an OPSEC exposure score (0–100), and HTML/PDF/CSV/Markdown exports.

14 of the 22 modules work with zero API keys (missing keys degrade gracefully instead of erroring).

Stack: FastAPI + Next.js 14, runs with one docker compose up. MIT licensed.

Demo: getprism.su Github: github.com/NovaCode37/Prism-platform

Built it solo - feedback welcome, especially on which modules you’d want added.

#selfhosted

threaded - newest

irmadlad@lemmy.world on 20 Jun 09:14 next collapse

That’s pretty darn cool:

<img alt="" src="https://lemmy.world/pictrs/image/73673338-4f37-4b78-bb08-735ae68a993a.png">

trulysoulless@lemmy.world on 20 Jun 10:01 collapse

Hiya, love that you actually tested it. That’s exactly the kind of 30-second recon it’s built for. The “missing security headers” check catches a surprising number of sites.

If there’s a module or source you’d want added, I’m genuinely taking requests that’s how the roadmap gets shaped. Thanks for trying it!

irmadlad@lemmy.world on 20 Jun 10:20 collapse

You bet. I’ve dropped it in my ‘Projects’ folder. Thank you for sharing.

anotherandrew@lemmy.mixdown.ca on 20 Jun 10:11 next collapse

This looks really cool. One minor bug: with the online demo, at least on mobile (chrome, iOS), the target text field never brings up the keyboard so it can’t be used.

trulysoulless@lemmy.world on 20 Jun 10:15 collapse

Oh thanks, I’ll fix that

ArcaneSlime@lemmy.dbzer0.com on 20 Jun 10:28 next collapse

So I have an interest in self hosting things in the future (nextcloud, chatmail), but for now I’m scared of opening my network to attacks, and also I don’t have a network right now I just hotspot from my phone when needed and torrent things at my friend’s house.

That said how would I go about using this? I’m guessing something to do with docker or porteus (maybe? The other one that wasn’t vulnerable to that recent thing), then when I want to check out X website I just “spin up the docker container” (still not 100% what that means but I’ve heard the verbiage), hotspot the pc (for now), and run it through the program? Am I understanding that right?

Sorry I’m so green, gotta start somewhere! I feel like a grandma calling an Xbox a “Nintendo” haha.

irmadlad@lemmy.world on 20 Jun 11:17 next collapse

Sorry I’m so green, gotta start somewhere!

We all started at green. No shame.

So, yes OP is using Docker. Once you install Docker on your server, you ‘spin up’ the docker container using the Docker compose file:

github.com/NovaCode37/…/docker-compose.yml

…and the associated .env file that houses all your environmental variables:

github.com/NovaCode37/…/.env.example

ArcaneSlime@lemmy.dbzer0.com on 20 Jun 11:52 collapse

Awesome, thank you for the help/info! This seems like a good first step, I’ll try it out!

irmadlad@lemmy.world on 20 Jun 11:58 collapse

Give it a go man. What’s the worst that can happen? …you have to drop back and do some studyin’. That’s pretty much how I learn. Read, Do, Fuck it up ad nauseam until it clicks, then I write that shit down.

ArcaneSlime@lemmy.dbzer0.com on 20 Jun 12:41 collapse

Same here lol, I will for sure!

FauxLiving@lemmy.world on 21 Jun 18:26 collapse

Putting yourself into the position of trying to solve a practical problem is the best way to learn.

If you fail completely, you can always restore your system and try again (you have a backup, right?)

ArcaneSlime@lemmy.dbzer0.com on 21 Jun 18:45 collapse

Yes, but I’d still prefer not to have to spend the like ~2h reinstalling and replacing my files.

That said this seems like a pretty low stakes trial which is why I’m looking at it first. Worst case a reboot (or recovery through live booting) should fix most issues, I think, if I understand correctly. I don’t plan to autostart the docker container so if it fucks my system up a reboot should put me back to normal if starting it breaks my sys right?

I do have some old laptops and an unopened router waiting for me to figure out openWRT. I could install some linux OS (deb?) on one of those and use that for docker, get off my ass and install openWRT on the router, and then use that to connect both devices (and I’d have to figure out which to hotspot but that is easy), if that’d be significantly safer for my daily driver. Then I’d have to figure out how to point my browser to that too though.

FauxLiving@lemmy.world on 20 Jun 11:19 next collapse

Yeah, this project is built as a docker container. The repo has instructions on starting the container. You should watch a few introductory videos on Docker so you understand the concepts and basic usage.

Once it’s started, the machine that docker is running on will be serving a website that acts as the application. If you’re running docker on your desktop you can then open a web browser and go to localhost:8080 and you will see something that looks like the demo link above.

This doesn’t expose it to the Internet. If you’re running this on a home LAN with a router between you and the ISP’s modem (or the ISP’s modem is a router/AP) then only computers connected to your network will be able to access it. You would have to go to your router’s administration console and specifically forward a port for that service so that people on the Internet could get past your modem.

ArcaneSlime@lemmy.dbzer0.com on 20 Jun 11:51 collapse

Awesome thanks for all the help and info, I’ll definitely check it out! I think this will be a nice step to help teach me these concepts and get me to the other projects!

realitaetsverlust@piefed.zip on 20 Jun 17:55 collapse

Sorry I’m so green, gotta start somewhere!

Start with the documentation. Docker has a great introductory section that teaches you the basics.

https://docs.docker.com/get-started/introduction/ (the pushing your image part is not that important, the rest is)

Running a project that does things you don’t know is not the best thing to learn. Learning is done by going through the basics first, not immediately firing docker compose, which is one step above pure docker.

ArcaneSlime@lemmy.dbzer0.com on 20 Jun 18:32 collapse

Thank you! I’ll check out the docker docs before I try spinning this up as my first trial run!

xyro@morbier.foo on 20 Jun 10:38 next collapse

Super cool, I’m gonna host it when I have some time !

eleijeep@piefed.social on 20 Jun 11:06 next collapse

Did the LLM choose the name? There’s an obvious existing semantic link between PRISM and intel, so congrats on choosing an un-searchable name.

trulysoulless@lemmy.world on 20 Jun 12:18 next collapse

Xd, prism is basically un-googleable that one’s on me cause there is not a great SEO foresight. The name was mine though

eager_eagle@lemmy.world on 20 Jun 14:22 next collapse

yeah, I know of two other tools with that name just from my workplace, both probably suggested by ai

Cethin@lemmy.zip on 20 Jun 18:11 next collapse

There’s also the NSA PRISM, which is older than the current LLM garbage. It’s just a basic ass name that makes for a good pun on something that changes how you see things.

eleijeep@piefed.social on 20 Jun 23:58 collapse

Yes that’s the one I was referring to.

caseyweederman@lemmy.ca on 22 Jun 04:04 collapse

Especially rough with the Snowden post on the top of most people’s front page today.

ikidd@lemmy.dbzer0.com on 20 Jun 11:31 next collapse

Some mailchecks would be useful. DNS and the server responses.

Edit: Oops, just found it, different section. Valid DKIM check would be handy. Also, I’m not sure what “Deliverable” is about, comes up as “No” for a domain I use for email with no issues.

trulysoulless@lemmy.world on 20 Jun 12:21 collapse

Thanks, gotcha. I figured marking those cases as inconclusive makes a lot more sense than treating them as failures. It should cut down on false alarms from catch-all and greylisted servers while still keeping the results reliable. Since I’m already checking MX, SPF, and DMARC, I should have enough confidence without being overly aggressive

EncryptKeeper@lemmy.world on 20 Jun 11:45 next collapse

Soviet Union TLD is an interesting choice lol

x00z@lemmy.world on 20 Jun 12:50 next collapse

Full of AI fingerprints yet no disclosure.

trulysoulless@lemmy.world on 20 Jun 13:06 collapse

Yep, I’m a solo dev and I use AI assistance while building this. So, I should’ve been upfront about it. The code’s all reviewed, tested, and MIT-licensed, so it’s fully auditable. I’ll add a disclosure to the README

4am@lemmy.zip on 20 Jun 13:52 collapse

So you vibecoded a security product and named it after a famous government program known for spying unlawfully on American citizens

To what, capitalize on the SEO?

This is kinda gross dude, not gonna lie

eager_eagle@lemmy.world on 20 Jun 14:25 collapse

at this point “prism” must be one of the most overused project names, there’s no hope for any seo using that name

clb92@feddit.dk on 20 Jun 13:00 next collapse

WHOIS exposes 2 contact email(s) — registrar privacy not used

Registrar privacy is in fact used. It’s just the Namecheap abuse email address and an anonymized *@withheldforprivacy.com mail address. It shouldn’t list those as results.

trulysoulless@lemmy.world on 20 Jun 13:07 collapse

Thanks, I’ll fix that. I’ll add a filter for known privacy-proxy and registrar abuse domains

mlg@lemmy.world on 20 Jun 13:22 next collapse

NSA is that you?

Also jokes aside, how does the use case compare to some existing tools like BBOT?

This seems morr geared towards public facing targets than targeted information OSINT (user profiling, etc.)

Decronym@lemmy.decronym.xyz on 20 Jun 14:30 next collapse

Acronyms, initialisms, abbreviations, contractions, and other phrases which expand to something larger, that I’ve seen in this thread:

Fewer Letters More Letters
AP WiFi Access Point
DNS Domain Name Service/System
ISP Internet Service Provider

[Thread #21 for this comm, first seen 20th Jun 2026, 21:30] [FAQ] [Full list] [Contact] [Source code]

notalannister@fedinsfw.app on 20 Jun 15:06 next collapse

Tried it. ANY given username generates a list of the same sites (e.g. instagram, reddit, imgur, etc) and simply slaps the given username to the base url and gives that as a “result” even if the user doesn’t exist on that platform. Even the “AI Analysis” is simply a report of nonexistent platforms and users. You can achieve better results by simply using a bash script.

K3can@lemmy.radio on 20 Jun 16:11 next collapse

Same experience. 🫤

notalannister@fedinsfw.app on 20 Jun 16:18 collapse

Yeah. Very disappointing.

chicken@lemmy.dbzer0.com on 20 Jun 16:17 collapse

What would be better ways of doing it?

notalannister@fedinsfw.app on 20 Jun 16:25 collapse

use curl and try to “ping” the user page to see if it exists (200) or not (400)

WhyJiffie@sh.itjust.works on 20 Jun 17:35 next collapse

Your targets never leave your PC

how can that be true if the whole thing relies on sending the infos to the API providers?

DieserTypMatthias@lemmy.ml on 21 Jun 00:18 next collapse

Great name indeed.

Stack: FastAPI + Next.js 14, runs with one docker compose up. MIT licensed.

Isn’t this what every chatbot builds with by default?

brainwashed@feddit.org on 21 Jun 23:14 collapse

Isn’t there also a palantir module called prisma or something?

DieserTypMatthias@lemmy.ml on 22 Jun 00:26 collapse

AFAIK no. The only prisma I know is this one.

brainwashed@feddit.org on 22 Jun 03:32 collapse

Ukraine apparently uses something by that name united24media.com/…/inside-ukraines-palantir-powe…

quick_snail@feddit.nl on 21 Jun 05:51 collapse

Terrible name. It’s taken.