热度观测:等待有效的新观测。

← 返回内容列表
GGitHub采集材料

Nightmare Mobile:手机本地生成图像与视频

发布时间未知 · 北京时间

图像与视频

AI 关联线索不足

代码仓库示例代码

原文与观测指标

1 个来源
GGitHub

Nightmare Mobile:手机本地生成图像与视频

AbrahamPaulJ
查看原文
星标130采集时的累计值
每小时增长待观察星标 / 小时 · 观测区间平均值
最近提交10-27 14:33提交时间不是项目发布时间

发布时间:未知 · 首次发现 10-27 15:48 · 北京时间

指标采集:10-27 15:48 · 指标已取得

项目文档有线索安装说明未发现使用说明未发现示例有线索

仅反映文档与示例线索,未实际运行项目。

摘要

Nightmare Mobile 在支持的 Android 骁龙设备上用节点图运行扩散模型,可进行文生图、图像编辑、放大和视频生成,无需服务器或云端。材料列出设备要求、模型支持情况及部分测试耗时。

摘要由 AI 生成,请以原文为准。
观测历史 · 最近 2 条 展开 / 收起

缺失不计为零;增长只比较同一指标来源的有效记录,按实际间隔折算每小时。上游缓存可能延迟数值更新。

采集时间 · 北京时间指标数值来源状态
10-27 15:48:15Star130GitHub 公开页面已取得
10-27 15:48:12Star130GitHub 公开页面已取得
采集原文 展开 / 收起

nightmare-mobile

On-device ComfyUI style node graph for image/video diffusion models on Android. Local SD1.5, SDXL, Flux, Z-image, Anima, Qwen Image 2.1, …
项目说明 展开 / 收起
Nightmare Mobile A node graph for image and video generation on Android, running on the Qualcomm Hexagon NPU. Text to image, image to image, inpainting, upscaling, image editing, text to video and motion transfer. All on the phone. No server, no account, no cloud. Download the APK · User guide · Report a problem What your phone needs Android 12 or newer, arm64, a Snapdragon with a Hexagon NPU. Models are not in the APK: pick one and it downloads on first use; the app shows which ones your phone can run. chip runs Snapdragon 888 and newer SD 1.5 8 Gen 1, 8+ Gen 1 alpha: Anima Turbo 1.1 and Anima 2.9B on the DiT engine, run on the CPU: on testers' phones the NPU never finished a DiT step there, so a 512x512 picture takes about 15 to 20 minutes. The face editor and face animator, with a build of their own for these chips (1.6.217). SD 1.5 Swap renders no longer fail after a face edit 8 Gen 2, 8s Gen 3 and newer alpha: Z-Image Turbo as a Q4_0 GGUF, FLUX.2 Klein 9B, Anima Turbo 1.1 and Iris 3B Turbo on the DiT engine. On the 8s Gen 4 and 8s Gen 3 they run with the NPU's matrix unit off and decode on the CPU for now, because with it the picture comes back grey or as noise: right pictures, but much slower (minutes at 512, far longer at 1024). A model's ⋮ Test the NPU finds which part fails, so it can be made fast again, and every error report now says whether the matrix unit computed a test sum right when the model started. Iris 3B Turbo is not offered there: every way of running it gives noise 8 Gen 3 and newer SDXL, Anima, community-converted SDXL and SDXL Swap models; alpha: FLUX.2 Klein 4B / 9B, Qwen Image 2.1 and 2.1 Turbo, Anima Turbo 1.1 on the DiT engine, Iris 3B Turbo (not yet run on an 8 Gen 3), MOSS-Image (not yet run on a real 8 Gen 3), Z-Image Turbo as a Q4_0 GGUF, FLUX.3 Image Klein, Fibo 2.0 Edit (12 GB), your own quantised (GGUF) DiT, Wan 2.2 video 8 Elite and newer Z-Image Turbo in FP8, SDXL Swap, Ideogram 4, Neodragon text and image to video, and all of the above 8 Elite Gen 6 alpha, not yet confirmed on a real one: SD 1.5, SDXL, Anima and the other NPU models, with the newer NPU's runtime (about 38 MB) fetched on first use (1.6.212 fixes the "Stub lib id mismatch" a tester's phone hit); the DiT models through a Gen 6 build of the engine's NPU code, the same change Local Dream made 12 GB RAM Ideogram 4 (8 Elite), Krea 2 Turbo (8 Elite; alpha on 8 Gen 3); on 12 GB it renders in parts, about 3.5 to 4 min at 1024² Features The canvas Built for a phone: big ports, snap to connect, pinch to zoom (out to 0.15x to see a big flow whole); the picture appears on the node that made it. The run bar folds to one row (+ Node, Run, the time, the locks) for more canvas. Cancel on a run over a minute old asks first, and an Output shows its picture as soon as it is ready. Local Dream's models, no second download: models Local Dream keeps in Download/LocalDream are listed and run in place, never changed or deleted. SDXL without the NPU: Local Dream's SDXL CPU/GPU zips (_mnn) import from + and render on the GPU, about 17 s a step at 1024² on an 8 Elite (the CPU is about 4 times slower), for phones whose NPU cannot run SDXL. Prompts up to 231 tokens. UltraFix: Local Dream's tiled repair: redraws the detail of an upscaled picture without changing it (SD 1.5 / SDXL). More options on the Image node holds the after-render switches below, folded away; closed, it names the ones that are on. Scheduler, seed and CFG fold the same way, closed until you open them, showing what they are set to. Switching one on that needs a download (the upscaler, the face and hand detector) offers it there and then. Hires fix: one switch on the Image node: render, enlarge ×2, then UltraFix, in one Run (SD 1.5 / SDXL). Every other model has Enlarge ×2 instead, so its picture can be enlarged and passed on to an inpaint that fixes faces. Fix faces / Fix hands (ADetailer): switches on the Image node. After the render the phone finds each face and hand (Bingsu's YOLOv8 detectors, a 25 MB Tools download) and redraws it enlarged, close up, with the same prompt, model and LoRAs (the Swap models too), its tone matched to the picture along the edge. Detection settings shows what is found on your last picture and sets the confidence, padding, mask blur and strength, for faces and hands apart. Switching a fix on keeps the picture you already made and redraws only its faces; a Fix seed with its own padlock tries another face on the same picture. Edit a face (LivePortrait): sliders for smile, eyes, gaze, mouth and a head turn, nod or tilt on the faces in any picture, previewed live in their own window (about a quarter of a second an edit on an 8 Elite). A Face edit node to wire after any picture, the Edit a face flow, and Edit face on a picture in Results. A 180 MB download in Models, Faces. Animate a portrait (LivePortrait): a photo of a face moving the way the face in a video you choose moves, up to 30 seconds at 25 fps. The photo keeps its own pose and follows the video's changes. About 0.2 s a frame on an 8 Elite, no checkpoint involved; the same Faces download. Colour: Match colours on the Image node keeps an image to image, inpaint or Fix faces result in the colours of the picture going in; Colour correction and Adjust colours (brightness, contrast, saturation, warmth) on the Output node, after every Run or on the last picture at a tap, without rendering it again. LoRA library: sort LoRAs by name, newest, most used or size, filter by base model, star favourites, set a LoRA's model by hand when its file is not recognised, and sort them into your own folders. Draw on a picture: doodle shapes and colours over the image node's photo (or a blank page) and let image to image make them real; pinch to zoom, pick a colour from the picture or any colour from a picker. Recipes: text to image, image to image, inpaint, upscale, edit a face, image edit, text / image to video, motion transfer and two Advanced flows, grouped as Pictures, Faces, Ad