自学内容网 自学内容网

[ComfyUI]Flux:开源可商用F1!Apache2开源OpenFLUX1模型,已去蒸馏可微调

大家好我是安琪!!!在人工智能领域,开源模型的贡献对于推动技术发展和创新至关重要。今天,我们兴奋地宣布,ComfyUI团队再次引领潮流,推出了OpenFLUX1模型——这是Flux系列中首个开源可商用的模型,它已经去除了蒸馏过程,并且可以进行微调,为图像生成与反推技术带来了新的可能性。
在这里插入图片描述

OpenFLUX1模型基于Apache 2.0许可证开源,这意味着它不仅可供个人和研究机构免费使用,还可以被商业实体集成到他们的产品和服务中。以下是OpenFLUX1模型的一些亮点:

可商用:OpenFLUX1模型允许商业使用,为企业和开发者提供了更多的灵活性和创新空间。
去蒸馏:OpenFLUX1模型经过特殊处理,去除了蒸馏过程,使得模型更加精简高效。
可微调:用户可以根据自己的需求对OpenFLUX1模型进行微调,以适应特定的应用场景或优化性能。

在这里插入图片描述
在这里插入图片描述

OpenFLUX.1简介

近日由作者 @ostris在huggingface上开源了Flux开源版本社区模型:ostris/OpenFLUX.1。作者称:该模型是作者花费了大量的金钱在计算资源上进行训练,经过多轮迭代训练版本。OpenFLUX.1模型是一个与FLUX.1可媲美的新模型(实测与FP8也略逊一筹,但开源可加强后期训练)。并且是完全开源的允许微调

OpenFLUX.1 模型是在开源 FLUX.1-schnell模型基础上进行微调的模型,并且已经去除了FLUX.1-schnell模型蒸馏过程。Flux Schnell是根据 Apache 2.0 开源许可的一个蒸馏模型。OpenFLUX.1 模型是一次在FLUX.1-schnell模型基础上尝试去除蒸馏过程,创建一个可以微调的开源商用许可的模型。

由于FLUX.1-schnell模型的蒸馏过程已经被微调出来,OpenFLUX.1 模型使用了经典的 CFG。因此也需要一个与原始 FLUX.1 schnellFLUX.1 dev模型不同的管道。作者为此创建了新的管道,并且可以在代码仓库的 open_flux_pipeline.py 中找到。目前作者推荐:3.5 的 CFG 似乎效果很好。

关于Apache 2.0开源许可Kimi的回答如下:

  • OpenFLUX.1模型地址:https://huggingface.co/ostris/OpenFLUX.1

OpenFLUX.1演示

OpenFLUX.1 ComfyUI体验

OpenFLUX.1的使用方式和FLUX.1-schnell类似,无需下载任何ComfyUI插件,使用和FLUX.1一样的checkpoint方式加载即可(测试不支持UNET加载方式,待进一步探索)。

  • openflux1-v0.1.0-fp8.safetensors:模型放置到 /ComfyUI/models/checkpoint/ 目录。下载地址为:https://huggingface.co/ostris/OpenFLUX.1/resolve/main/openflux1-v0.1.0-fp8.safetensors?download=true

  • openflux1-vae.safetensors:模型放置到 /ComfyUI/models/vae/ 目录,建议下载模型并rename。下载地址为:https://huggingface.co/ostris/OpenFLUX.1/resolve/main/vae/diffusion_pytorch_model.safetensors?download=true

Flux文生图工作流

OpenFLUX.1工作流

OpenFLUX.1工作流如下所示,需要使用Flux的checkpoint方式加载。并且在工作流中,笔者也加入了Flux DEV FP8模型(OpenFLUX.1当前仅开放FP8模型。为了避免云存储资源FluxDev继续采用UNET加载方式

比对工作流全貌

注意:在运行OpenFLUX.1模型时候,明显能感觉到运行速率会比较耗时。出图质量与同等量化的Flux.1-DEV-FP8模型会差一些。但是必究是社区开源可商用版本,可加强后期的数据集训练解决。

01. 神枪手

This is a real high-definition photo, This is a high-resolution portrait photo. a high-resolution photograph featuring a young asian woman with light skin and long, dark brown hair tied in a high ponytail, she is wearing a navy blue visor with a white logo that reads fc sportswear, and a light blue and white t-shirt underneath the visor, her expression is focused intently on the task at hand, holding a black handgun with a scope mounted on top, the background is blurred, suggesting an outdoor setting with green grass and trees, indicating a park or outdoor area, the lighting is soft and natural, likely during the day, with sunlight filtering through the trees, creating a warm and inviting atmosphere, the woman’s wristwatch is visible on her left wrist, adding a touch of sophistication to her casual attire, the overall mood of focused and determined, with a sense of readiness and readiness for action (asian), 1girl, solo, long hair, looking at viewer, shirt, black hair, holding, ponytail hair, weapon, short sleeves, outdoors, day, looking to the side, bag, watch, blurry, blurry background, black shirt, holding weapon, bracelet, gun, visor cap, realistic, nose, aiming, watch on wrist, rifle, scope, sniper rifle

在这里插入图片描述

02. 沙滩

This is a real high-definition photo,This is a high-resolution, casual half-body portrait photo. The subject of the photo is a young woman wearing a white tank top and a denim jacket, with the sleeves of the jacket rolled up. She has black hair that falls over her shoulders. Her right hand is raised, shielding it from the sun, as if she is enjoying the seaside view. The background shows a beach and the ocean, with waves crashing against the shore and a small boat moored on the beach.

在这里插入图片描述

03. 善恶一念

This is a high-resolution,everyday scene image with a natural style,Create a movie poster with a dual-view design. On one side, depict a serene angelic figure against a pure white background, featuring a 20-year-old Chinese girl with an ethereal glow and delicate wings. On the other side, transform her into a captivating devil with striking horns and a fiery aura, set against a deep black background. Both images should seamlessly merge into one dynamic poster, capturing the contrast between light and dark, good and evil.

在这里插入图片描述

04. 红裙

This is a high-definition artwork with a warm overall tone. In the picture, Asian women, there is a lady wearing a red sundress. She is facing rightward with her body and her head slightly turned to the left, looking towards her left hand. She appears to be between the ages of 20 and 30, female, slim, with a calm expression, wearing a red sundress, with black hair, long hair flowing over her shoulders without bangs. The background is a wall covered with various photographs and paintings, the styles of which vary from abstract to realistic, and some are vibrant in color.

在这里插入图片描述

05. 黑丝

This is a high-definition mobile photography work with a modern urban style. In the picture, there is a woman wearing a black tight-fitting top, a black choker, and black stockings tied around her thighs. She holds a gun in her right hand and her left hand hangs naturally at her side, her gaze fixed and steady as she looks into the camera. Her hair is brown and falls in loose waves. The background consists of a white wall and a brown circular mirror.

在这里插入图片描述

另外Pulid-Flux、OpenFLUX.1工作流在笔者仙宫云镜像中已部署完成,也可以简单一键开始快速体验。

资料软件免费放送

次日同一发放请耐心等待

学好 AI绘画 不论是就业还是做副业赚钱都不错,但要学会 AI绘画 还是要有一个学习规划。最后大家分享一份全套的 AI绘画 学习资料,给那些想学习 AI绘画 的小伙伴们一点帮助!

需要的可以扫描下方CSDN官方认证二维码免费领取【保证100%免费】

在这里插入图片描述

**一、AIGC所有方向的学习路线**

AIGC所有方向的技术点做的整理,形成各个领域的知识点汇总,它的用处就在于,你可以按照下面的知识点去找对应的学习资源,保证自己学得较为全面。

在这里插入图片描述

在这里插入图片描述

二、AIGC必备工具

工具都帮大家整理好了,安装就可直接上手!
在这里插入图片描述

三、最新AIGC学习笔记

当我学到一定基础,有自己的理解能力的时候,会去阅读一些前辈整理的书籍或者手写的笔记资料,这些笔记详细记载了他们对一些技术点的理解,这些理解是比较独到,可以学到不一样的思路。
在这里插入图片描述
在这里插入图片描述

四、AIGC视频教程合集

观看全面零基础学习视频,看视频学习是最快捷也是最有效果的方式,跟着视频中老师的思路,从基础到深入,还是很容易入门的。

在这里插入图片描述

五、实战案例

纸上得来终觉浅,要学会跟着视频一起敲,要动手实操,才能将自己的所学运用到实际当中去,这时候可以搞点实战案例来学习。
在这里插入图片描述
这份完整版的学习资料已经上传CSDN,朋友们如果需要可以微信扫描下方CSDN官方认证二维码免费领取【保证100%免费】

在这里插入图片描述


原文地址:https://blog.csdn.net/2401_85725028/article/details/142739339

免责声明:本站文章内容转载自网络资源,如本站内容侵犯了原著者的合法权益,可联系本站删除。更多内容请关注自学内容网(zxcms.com)!