Custom Model Import — Analysis

Module 3 Assessment | SA Enablement 2026 | Xinzhi Sherry Zhu (zhxinzhi)

1. Model Selection

PropertyValue
ModelQwen3-0.6B (Qwen/Qwen3-0.6B on Hugging Face)
ArchitectureQwen3ForCausalLM (Transformer decoder-only)
Parameters0.6B (under 3B requirement)
PrecisionBF16 (bfloat16)
Context Length40,960 tokens
FormatSafetensors (1.5 GB)
Import Regionus-east-1
Model ARNarn:aws:bedrock:us-east-1:618044871166:imported-model/avb0abvfws58

Why Qwen3-0.6B?

2. Import Process

Required Files (uploaded to S3)

FileSizePurpose
model.safetensors1.5 GBModel weights (28 transformer layers)
config.json726 BArchitecture definition (hidden_size, num_layers, etc.)
tokenizer.json11 MBFull vocabulary + BPE merge rules
tokenizer_config.json9.5 KBSpecial tokens, chat_template (ChatML format)
merges.txt + vocab.json4.3 MBBPE merge rules + vocabulary (redundant with tokenizer.json)

Steps

  1. Download from Hugging Face (snapshot_download)
  2. Upload to S3 bucket (sa-enablement-cmi-models-618044871166)
  3. Create IAM role with S3 read + Bedrock trust policy
  4. create-model-import-job — completed in ~10 minutes
  5. Model available via InvokeModel API with OpenAI Chat format

Technical Notes

3. Response Demos (5 examples)

Q: What is cloud computing? Answer in 2 sentences.
Cloud computing is a model where computing resources such as servers, storage, and applications are hosted in a remote location and accessed over the internet. It allows users to access and manage these resources on-demand, providing flexibility and cost savings.
Latency: 819ms | Input: 19 tokens | Output: 210 tokens
Q: Explain the difference between IaaS, PaaS, and SaaS.
IaaS (Infrastructure as a Service) provides cloud infrastructure, such as servers, storage, and networking, to users on a subscription basis. Examples include AWS EC2, Google Cloud, or Azure. PaaS (Platform as a Service) provides a platform for building, running, and managing applications without managing the underlying infrastructure. Examples include AWS Elastic Beanstalk, Heroku. SaaS (Software as a Service) delivers software applications over the internet, typically on a subscription model. Examples include Gmail, Salesforce, and Dropbox.
Latency: 1,655ms | Input: 23 tokens | Output: 571 tokens
Q: What are the benefits of using serverless architecture?
1. Cost Efficiency — No need to manage or allocate servers, reducing operational costs. 2. Automatic Scaling — The provider handles infrastructure scaling automatically. 3. Faster Development — Focus on code rather than infrastructure management. 4. High Availability — Built-in redundancy and fault tolerance. 5. Pay-per-use — Only pay for actual compute time consumed.
Latency: 1,774ms | Input: 18 tokens | Output: 634 tokens
Q: Write a Python function to calculate the Fibonacci sequence.
def fibonacci(n): a, b = 0, 1 result = [] for _ in range(n): result.append(a) a, b = b, a + b return result
Latency: 3,185ms | Input: 18 tokens | Output: 1,192 tokens
Q: Summarize the key principles of DevOps in bullet points.
- Collaboration between development and operations to streamline processes - Automation of repetitive tasks to save time and reduce errors - Continuous delivery of high-quality software to stakeholders - CI/CD pipelines for automated testing and deployment - Monitoring and observability for proactive issue detection - Infrastructure as Code (IaC) for reproducible environments
Latency: 921ms | Input: 21 tokens | Output: 239 tokens

4. Comparison with Bedrock Foundation Models

MetricQwen3 0.6B (CMI)Claude Sonnet 4.6Nova Pro
Avg Latency1,671ms12,295ms1,366ms
Output QualityGood for simple tasksExcellentVery Good
Cost$0 (CMI on-demand)$0.030 / 3 calls$0.003 / 3 calls
ReasoningYes (think tags)Yes (extended thinking)No
Best Use CaseInternal tools, prototypingCustomer-facing, complexProduction chat, balanced

Key Observations